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This manual is a technical resource for helping drug 
treatment program directors decide lihetfcer tc do a fcllo«-up of a 
^client population and^ if so^ how to do one. Each chapter was written 
iy a particular set of authors. However, the poiits contained in the 
chapters had to receive the general agreenent of a committee whose 
membership included representatives not only from the research 
community, but also from the National Institute on Drug Abuse (NIDA) 
and the treatment community. After completing the first three 
chapters, the readier should have the iEfcrmaticn needed to determine 
whether to do a follow-up, and how to plan it in detail and make 
staffing assignments, if the decision is to proceed, Ihe remaining 
chapters provide detailed guidance for iEpleaenting each of the 
research stages. A few cf the areas covered axe: technigtses for 
successfully locating respondents, interviewing techniques, 
confidentiality, guidelines for preparing the data for analysis and 
conducting the analysis, and suggestions on how a repcrt night be^ 
organized. The appendix includes many Sfecific examples of interview 
questions and interviewing training materials. (Author) 
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FOREWORD 



The history of the drug abuse field shows that real innovation and 
CTeative contributions to our fundamental knowledge about drug abuse 
are more likely to come from creative individuals working with specific 
problems in local programs than they are from massive national studies. 
My own experience with the local Washington, D .C . , heroin problem 
taught me that it is easier to grasp reality and put it on paper when 
considering a local heroin epidemic than it is at the Federal level. 

No issues are as important to local program staff as the questions of 
what happens to clients in treatment and what happens to them when 
they leave treatment programs . It is often difficult to turn intense 
interest in these questions into practical studies because the local 
staff lack the technology to carry out the study. To meet this need, 
we , at the National Institute on Drug Abuse (NIDA) , have developed two 
handbooks which bring the most sophisticated evaluation and foUowup 
methodologies within the grasp of the serious treatment program staff. 

The first volume, written by Guess and Tuchfeld, is' called the Manual 
for Drug Abuse Treatment Program Self-evaluation . It is fully com- 
patible with the Federal CODAP system , but it can also be used with 
virtually any routine data system . 

The second volume extends this work to the even more complex area 
of foUowup studies. The authros and editors are among the mos^ 
distinguished research scient^.sts in the drug abuse field. They have 
each conducted and published historic studies which are now changing 
the way we think about drug abusers. In this new volume , they have 
taken complex theories and controversial techniques and distilled the 
practical essence for use by local program staff. The more sophisticated 
researcher can use this volume to assess the basic literature in the 
field. The more practical drug abuse worker can feci secure in the 
knowledge that this deceptively simple guidebook has been put together 
for him by the best minds in the field. 

vii 



8 



Because our drug abuse field has been on the forefront of knowledge 
development in the program evaluation and foUowup fields , both of 
these volumes will also prove useful to practical researchers in other 
fields in which intervention programs are designed to produce measur- 
able behavioral changes . 

When you do a study in your program, I hope you will let us at NIDA 
know what you found useful in this book and in what ai*eas it could be 
improved. Also, please let us know what your study results are. We 
want to know what you learn about your program. 

Robert L. DuPont:, M,D. 
Director 

National Institute on Drug Abuse' 
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PREFACE 



There are nearly 2000 Federally-funJed programs in the United States today, providing 
a variety of treatments to drug abusers. Since most of the directors and staff of these 
p'^ograms have an interest in what happens to their client populations after treatment— 
and in demonstrating to funding agencies, among others, that what happens represents 
an improvement as a result of treatment --there has been a continuing interest in 
conducting follow-ups of former clients. However, given that most program personnel 
have not been trained in research, a lot of effort may be wasted if follow-up studies 
are not undertaken properly. 

Recognizing this state of affairs. Dr. Robert DuPont as Director of the National 
Institute on Drug Abuse (NIDA) commissioned a committee— comprised largely of 
experienced researchers in the drug abuse field --to develop a manual to guide program 
personnel in the conduct of follow-up studies. This document is the product of that 
committee. It is intended' as a technical resource to be used in deciding whether to do 
a follow-up of a, client population and, if so, how to do one. Its recommendations 
reflect the combined judgement of the committee members. 

The Approach of the Committee 

A word about the manner in which this volume was written may help the reader to 
understand the judgements reflected here. Each chapter was written by a particular 
stt of authors, as the credits indicate. However, the points contained in the chapters 
had to receive the general agreement of the larger committee, whose membership 
included not only reprebentatives from the research community, but from NIDA and 
the treatment community, as well. 

The members first convened in February, 1976 to agree upon a list of topics for inclu- 
sion in the volume, generate i. number of specific ideas, and assign authorships. They 
reconvened a few months later to review first draft chapters and consider revisions. 
It was at this stage, in particular, that a number of conflicting viewpoints were aired 
and generally resolved. This integrative process was important to the development 
of what Is hoped to be a comprehensive and balanced approach to the problem. The 
necessity of developing a consensual set of recommendations was, in fact, the major 
justification for a . _mmittee doing what it is said a committee should never do—write 
a book. In the judgment of the editors it was a worthwhile, if sometimes frustrating, 
process: and the final product benefited from, the multiple viewpoints represented on 
the committee. 

Upon completion of the substantially revised second -draft chapters, the editors took a 
heavy hand In the Interest of brevity and consistency In style and level of detail. The 
authors then received une more chance to preserve cherished Ideas and phraseology. 
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Who Should Read This Manual? 



It has been assumed that the readership of this manual is comprised of professionals 
who are not trained researchers, although researchers may have an interest In its 
contents. The manual is directed toward two types of readers; (1) individuals who 
must decide whether to Initiate a follow-up study, presumably the directors of treat- 
ment programs; and (2) the individuals who will carry out the research. 

4 

While th^ prlmai-y intent of this manual is to guide the directors and personnel of 
drug treatment programs, much of what is contained here could be generalized to other 
teeatment clientele, such as those from alcohol and mental health facilities. There- 
fore, this manual can be used by staffs of other service agencies as well. The portions 
of the manual which are inappropriate for such readers --such as the suggested inter- 
view content — should be obvious to them as they proceed. 

How to Read the Manual 

For pxarposes of deciding whether or not to undertake a follow-up study, the reading of 
Chapters* 1 through 3 will suffice. Chapter 1 provides a general introduction and outline 
of the goals which can and cannot be accomplished with follow-up studies. These issues 
are particularly irnportant, since the establishment of realistic goals and expectations 
seems to be one of the hardest steps when imdertaklng such a venture. Chapter 2 
reviews the Issues which should be taken into account in plaimlng for such a study, 
Including the estimation of personnel and financial resources. It also provides an 
overview of the various stages of the research process, stages which are then discussed 
in much more detail in the subsequent chapters. 

Chapter 3 discusses the major types of alternative research designs, and what kinds of 
questions can be answered with each. Selecting a design based upon your Interests and 
available resources Is an important first step. Also covered in tills chapter are the 
techniques and considerations to be taKen into account in drawing a sample of clients 
for follow-up. 

\fter completing the first three chapters, the reader should have the Information 
...eeded to determine whether to do a follow-up, and how to plan It In detail and make 
staffing asslgzunents, If the decision is to proceed. 

The remaining chapters provide detailed guidance for implementing each of the research 
stages. Those responsible for actually implementing such a study are advised to read 
the entire manual through quickly, and then to study each chapter more carefully at the 
appropriate st^e. It may also prove beneficial to have staff members who will be 
working on the project read the chapters relevant to their tasks. 

Chapter 4 describes the process of developing the content for your Interview or ques- 
tionnaire, and general principles and examples are provided. Since the selection and/or 
development of good questions is a particularly difficult and time consuming task, 
specific questions are Included In an appendix to Illustrate many of the questions most 
uften Included In foliow-up studies. They are presented for consideration with the 
recognition that you may wish to include questions about topics which are not included 
here and/or use different measures for some of the topics which are Included. Having 
some specific suggestions, however, will at least provide a starting place for every- 
one and win probably meet most of the measurement needs of most readers. 



ERLC 



Once a research design has been chosen, a sample of clients drawn, and an interview 
developed, the next major stage is the actual collection of data. Chapter 6 suggests 
techniques for successfully locating respondents and outlines some of the difficulties 
.»hich should be anticipated in the process. Chapter 7 deals with interviewing and 
includes recommendations for the selection, training, and supervision of your inter- 
yiewers.^ Chapter 5 , points out the necessity for .protecting, respondent confidentiality 
during the locating and interviewing stages, and gives some very practical suggestions 
for providing such protection. 

Some alternatives to gathering data directly from clients are discussed in Chapter 8 — 
primarily the use of institutional records. Not all programs will want to seek data 
from such sources, but this chapter gives an overvie*v of the types of institutional 
records which are generally available and of the necessary procedures for accessing 
each type. 

Once the full set of data has been secured, there remain the tasks of analysis and 
writing. Chapters 9 and 10 provide guidelines on how to prepare the data for analysis 
and how to actually conduct the analyces. These, of course, are complex topics about 
which entire courses are taught. Nevertheless, the authors provide some fairly simpU, 
general guidelines for individuals who are not experienced at data analysis. 

The concluding chapter suggests how a final report might be organized and provides 
some suggestions and ca/eats about interpretation. It also reviews some of the ways 
in which the results might be used by the treatment program. 

Acknowledgements 

The editors are indeed grateful to all of the committee members for their tiaie spent 
in the development a^id writing of this volume, and for their cooperativ.'^ness and flex- 
ibility at the editorial stage. Trying to integrate the ideas and writing of no many 
people can be difficult at times --particularly for the authors --but everyone approached 
the effort with good humor as well as dedication. 

It is Impossible tu thank all of the many programs and agencies who field tested this 
manual, but we wish particularly to mention Rev. Richard Hamilton and Dr. Eugene 
Farrell at the Maryland Drug Abuse Administration, and Mr. John M. Lord and Dr. 
Claudio Toro at the Regional Drug Abuse Program, Department of Psychiatry, 
University of Alabama in Birmingham. Special thanks should also be given to Mr. 
Michael Gold at the Achievement Through Counseling and Treatment iProgram, 
Philadelphia, Pennsylvania, and to Mr. James E. Rivers at the Comprehensive Drug 
Program in Dade County, Florida. 

We are additionally grateful to the Addiction Research Center at Washington University 
In St. Louis for providing a home for the work of this committee. Dr. Samuel Guze, 
Chief of the Department of Psychiatry, and Dr. Donald Goodwin, Director of the Center, 
provided valuable cooperation from the outset. 

We hope that this document will prove of assistance to the directors and staff of many 
treatment programs across the country, and ultimately contribute to the improvement 
of the human services they provic^^. We hope that it proves useful to you, specifically, 
and we wish you good luck in your follow-up venture. 

L.J. 
D.N. 

xi L.R. 



Chapter 1 



INtRQbUCTION TO THE USE OF FOLLOW-UP STUDIES 
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Institute for Social Research 
The, Ohivefsity of Michigan 
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What to Expect K should be stated clearly from the outset that follow-up studies 

- . ~ are.among,the;ano8t.compUcated*of«all-research-studieS'to-conduct' 
and to interpret correctly. New^research^ techniques are still 
being developed and the noany experienced research scientists 
continue to debate the merits of the techniques which currently 
are available. Therefore, it is not possible for this manual or 
any other, for that matter, to transform its readers into masters 
of a foolproof method. The available methods- are themselves far 
from foolproof and even to provide a conaplete understanding of the 
existing ones—particularly of the analytic techniques — is well 
beyond the scope of any single volume. 

What, then, is a realistic e:qpectation for the reader? It is for you 
to become familiar with the possibilities and limitations of follow- 
up studies, with the basic principles which should be followed in 
the design ^.ud interpretation of such studies, and with some spe- 
cific techniques of proven effectiveness. You should not-e3q)ect to 
learn the more sophisticated analysis techniques: only the simpler 
variety can be covered here. 



WHAT IS A FOLLOW-UP STUDY? 

Follow-up studies include any research in which a sample is iden- 
tified at one point in time, and then later located personally or In 
records to learn what has happened in the intervaU Tn this volume, 
)lt will be assumed that the occasion for identifying the individual 
initially is his enrollment in or his departure from a. di^ug.treat- 
meht program. The length of enrollment which makes him.eliglble 
for inclusion In.the study will be determined by those directing the 
study. Similarly, the interval of time between a person's depar- 
ture from a program and his eligibility for inclusion in the follow-up 
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is a research decision, although six months would likely be the 
minimum interval you would want to use. 

The length of time to be spent in relocating and reevaluating sub- 
jects is another important decision to he made in the design of 
foUow-i?) studies. Most, such studies, are confined to some discrete 
time period such as three months or six months. While in prin- 
ciple it is possible to conduct a continuous study of the ongoing 
stream of clients who are lieavingthe program, it seems unlikely 
that many will find this an attractive approach. It is expensive; 
sometimes the results never get analyzed when there is no fixed 
end-point; and since the subjects encounter different labor markets 
and different qpportimities to use drugs due to historical changes, 
their outcomes may not be comparable. 

Another decision about time that must be made in a follow-up study 
is the number of past years from which departing clients are to 
be sampled and studied. At the one extreme, you could sample 
from all clients who have comp leted, the. program since.it s;.incep-- 
tion. At the other extreme, you migiit study only clients who 
entered treatment during a specific six months. If you think that 
your clients have changed over time, you may want to conapare 

„ .cUents,.se.en:.at.the.,beglnning,Avitli.thpse;seen-recei^ ..The.de:^, 

cision will depend in part on the questions you want to answer and 
in part on how big your program is. Small programs will have to 
accept subjects seen over a longer period to. get enough cases. 
When it is possible, however, the study is easier to analyze when 
clients all entered about the same time and are all followed over 
roughly the same period of time so that the same length of foUow- 
iq) interval and the same historical period will apply to all of them. 

OBJECTIVES OF FOLLOW-UP STUDIES 

It is very important for anyone thinking about conducting a follow-up 
study to be aware early of what s/he e3q)ects to accomplish. There 
are several basic objectives to which follow-up studies can be 
addressed, and they differ substantially in the complexities and 
difficulties which will be encoimtered in accomplishing them. 

Perhaps the most attainable objective is to develop some systematic 
information on the fate of your clients after they leave your pro- 
gram. Leaving aside the question of whether your program has 
had any impact, or "enough" impact, you can learn some valuable 
information about the natural history of your client population over 
some defined period following their treatment experience. By using 
a representative sample of the client group, however^ yoji choose to 
define it, and by locating and interviewing them, you c'\n get a 
good notion of how many found legitimate employment, how well 
they are functioning in their work, how many stayed out of trouble 
with the law, how many married and had children, and so on. You 
should also be able to get a reasonable notion of the proportions 
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who continued drug use and who sought help from drug programs 
elsewhere aifter leaving your program* 



Descriptive Informa- 
tion on Services 
Deliverid 



Client Reactions 
To the Program 



Such -information can be helpful in formulating program goals or 
revising program emphasis. For example, if it turns out that 
locating a legitimate job is a central problem for most of your 
clients in the year* after treatment, presumably you would want to 
consider placing a greater eniphasis. on job counseling, job place- 
ment, and perhaps job training. Whether a greater effort in this 
direction \^dU ultimately, prove successful. is another question, but 
at least the need has been clearly identified. 

Another way in which such information may prove helpful is in,pro- 
viding some basis for forewarning your current and future clients 
of the problems they can expect to encounter after leaving tha pro- 
gram. You would obviously want to use judgement in determirdng 
what information can be incorporated constructively by clients and 
what information might be discouraging; but, certainly some of it 
can be used constructively. 

Another type of Information which also may prove useful for pro- 
gram improvement concerns the quantities and types of service 
actually^received^by^your clients during theiir enrollment in your* 
treatment program — such things as amount of individual counseling 
received, amount of group counseling received j and so on* Re- 
member that the prescribed regimen of treatment may be quite 
different from the treatment services actually-delivered. There- 
fore, it is useful to gather systematic information on the latter so 
that the reasons for discrepancies can be ei5)lored, and perhaps 
some improvements made. 

In a follow-up study you have a particularly good opportunity to get 
a view of the program from the client! s perspective. While you 
could ask clients during treatment about their views on the strengths 
and weaknesses of the program, it is quite possible that better in- 
formation can be derived at some.point after treatment, when they 
are no longer dependent upon the evaluations of the program staff 
and when they have had a little time to gain some perspective on 
the whole experience. It seems reasonable to suppose that the 
clients themselves can come up with some useful information about, 
existing problems and possible improvements. Questions can be 
asked about overall satisfaction or dissatisfaction with the program, 
about satisfaction with various specific aspects of the program, 
about the degree to which various problems were encountered 
during treatment, and so on. You can also learn more about the 
reputation of the program among users "on the street," which is 
likely to be an important factor influencing the number and types of 
people, who sejek treatment. Finally, you may learn more about 
clients' reasons for dropping out of the program early. 
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It would be desirable for any service delivery program to take a 
periodic accounting of the characteristics of the clients it is serving 
and of those who withdraw early, and to note any changes in these 
characteristics over time. A follow-up study is hot required to 
accomplish these tasks. However, the occasion of conducting a 
study may also provide the stimulus and mechanism for doing such 
an. accounting,- particularly if one has not been done for some time, 
C&vidusly changing trends in the composition of the client popula- 
tion or in the types of clients who chose to leave treatment early 
are likely to have implications for the program's content and per- 
haps the nature of its staffing* 

The benefits just discussed can be derived from virtually all 
follow-up studies, and ironically they are some of.the most often 
overlooked. When people think about follow-ups, it seems that 
their si^ts are immediately set on quantifying and evaluating the 
overall impact of the program. 

Of course, there is nothing intrinsically wrong with having such a 
goaU The problem comes in failing to realize that attaining it may 
be unrealistic in many cases, because of a shortage of resources 
needed to do the research and/)r because of the unavailability of 
'the*data*necessary'*for^developingnmambigubus"conclusions;^ - 

To put it at its simplest, to determine the effects of some inter- 
vention like treatment, you must determine what would have 
happened to the clientele in the absence of that intervention. Since 
they were In treatment, it is not possible to know what wpuld have 
happened to the clients without treatmeiri;j The best approximation 
is to study people who are just like them in all other respects ex- 
cept for treatment. This is the notion of a "control group. " 

The way that scientists usually try to assure that their control 
group is like their treatment group in all relevant ways is to 
randomly assign subjects to the treatment and non-treatment con- 
ditions at the outset — a procedure which exists in very few, if 
any, drug treatment programs. Without the random assignment 
procedure, it is extremely likely that individuals who are selected 
for treatment are systematically different from those not selected. 
Similarly, those who self -select themselves into an untreated con- 
trol group by not showing up for treatment after admission or 
dropping out early are very likely different from clients who con- 
tinue to attend. These systematic differences (perhaps in back- 
ground characteristics, legal status, motivation, psychological 
stability, etc. ) between those treated and those not, may accoimt 
for any differences observed in their ^'success" rates. E is, of 
course, possible to try to determine in what ways the treatment 
group -and, the.controLgroup were^dlfferent-initially, and.then.to. 
control for those differences in the analysis or to try to "correct" 
for them statistically. However, you never know for sure that you 
have identified all of the infiportant initial differences between the 
treatment group and the control group, and just one undetected 
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difference may be the one accounting for the entire difference in 
the success rates of the two groups^ Therefore, drawing causal 
inferences from follpw-iQ) studies about the effects of drug treat- 
ment programs ~ or for that matter, any other intervention in 
which random assignment is not used — is always an uncertain 
business* 



Comparing the 
Effects of Different 
Programs 



Comparing 
Modalities in 
Your Own 
Program 



One Important thing can be determined in this regard, however, 
and that is the upper limit of program effects. If yon determine 
that only 50 per cent of all your clients secure legitimate employ- 
ment within a year after leaving treatment,, then you know for 
certain that at best your program accounted for i^alf the clifentele^s 
attaining legitimate employment... The upper limit may be useful 
to have, but your inabiUty to be more specific about the amount of 
program impact can be most frustrating, if you. start out with ex- 
pectailons of getting some definitive and precise Miswers. 

While you may not have an appropriate non-treatment control groi:?) 
agalhst which ypu can compare your results, you niay be able to 
compare your findings with those from similar programs. This is 
feasible only if you have conoparable . client: groups and evaluate 
them after an interval of the same length, using the same criteria — 
which^generally-means^that the'two^^programs-must-agree-in-advance- 
to use the same study design.. However, if you wish to compare 
your program's results with the-^published^re suits of another pfor 
gram, you should communicate with the study director at the other 
program to learn exactly how his study was done before beg innin g 
your own. What can be estimated from this type of design is not 
the absolute effect of either treatment program, but rather their 
relative effectiveness one to another. 

Just as a treatment group can be con5)ared to an untreated group 
or to a group treated in a different program, so can groups treated 
by different modalities in the same center be compared to one 
another. Again, what is being evaluated is the relative effective- 
ness of different treatment modalities, rather than their absolute 
impact on clients. 

Of course, without random assignment of clieiffis totreatmieht 
modalities (or to programs, if entire programs are being com- 
pared), the interpretation problems are formidable, since there 
are likely to be systematic differences in the types of people who 
enter different treatment regimens or different programs. Never- 
theless, the urge to make such comparisons is usually too strong 
to be resisted; and, as long as the ambiguities in interpretation 
are kept firmly in mind, such comparisons may provide some use- 
ful perspectives. 
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SETTING REALISTIC GOALS 

Perhaps the niost in]{)ortant stage in the evolution of a follow-up 
study is at the very beginning, when its sponsors and directors 
form their goals and eiqpectations for the study. Since the adop- 
tion of unrealistically hi^ expectations of such research Is almo^ 
a universal phenomenon, probably the most valuable piece of 
advice tha.t can be given is to assume modest and realistic goals. 
Follow-up studies can do some valuable things for you; but there 
ariB many things that they cannot do — particularly when a relatively 
small number of clients is being studied in a single treatment 
program, with limited comparison groups available. A clear 
realization of that fact frona the outset can prevent some disappoint- 
ments, as well as some missed opportunities. 

A careful reading of Chapter 3 on design alternatives should give 
you a good notion of which among the inany goals is realistic for 
you within the constraints that you have. Among the constraints 
discussed there are the availability and use of control or com- 
parison groups and the use of after-treatment data- only (which 
implies a shorter time for the study) as distinct from data from 
before and after treatment. 

If you feertKt you can afford the monetary ancl staff costs needed 
to conduct a reasonably adequate foilow-up study, at a minimum 
you should be able to get some valuable Information on the natural 
history of your clients after treatment and on their e3q)eriences 
and feelings about your program. Whether, beyond tl^, you 
nai^t be able to determine the relative efficacy of your different 
treatment modalities, or the relative or absolute efficacy of your 
program(s) is quite another question. In most cases these will be 
quite difficult, if not impossible, goals to attain. However, after 
you have read the next two chapteEs,..you.probably will be in a 
reasonable position to . determine if you can. If you still remain 
imcertain about what you can realistically expect to accomplish 
with a follow-i^) study, however, that is an appropriate point at 
\^diich to stop and seek the assistance of an expert in follow-up and 
evaluation research. 

THE IMPORTANCE OF IMMEDIATE EFFECTS 

This volume concentrates on the behavior and e:iq)eriences of clients 
after leaving treatment. However, the more immediate effects of 
the program on client behavior and satisfaction during the treat- 
ment period certainly should not be overlooked. Such things as re- 
ducing drug use, in^roving health, decreasing criminal behavior, 
increasing employment smd/or education, and generally improving 
the life experience of the client are all valid outcomes during treat- 
ment as well as after. In emphasizing outcomes after treatment in 



18 

6 



this volume, It is certainly not the intention of the authors to de- 
value tho more immediate effects-of treatment; and the reader 
should be cautioned not to do so either* 

Jn fact, it is quite possible to.lntegrate a follow-up evaluation 
which has been plaxined in advance with an In-treatment evaluatiocj* 
Many of the Interview items si^gested in this volume for use at 
admission and follow-up could also be used in interviews at inter- 
mittent intervals during the treatment period. 

COMPARING COSTS AND BENEFITS 

Once you have determined the goals \^^ch you can realistically 
e^ect to accoi3iplish and the costs to the program of conducting a 
follow-up study adequate to accomplish them, you will want:to tak^ 
a careful look at the overall desir^iUty'of the venture. FoUow-up 
studies will not make sense for all programs. For Instance, you 
may already be accomplishing many of the same objectives less 
e:q)ensively through other means. Sinailarly, the program may be 
too new or may have changed too recently for an adequate sample 
to be drawn yet. On the other hand, external realities related to 
funding or political support for the program may dictate that such, 
.a.study be.done.no.matter jvhat., ..Obviously:,, these. are.alLf actors, 
which you will have to wei^ in determining, whether and \^en a 
follow-up study is desirable for yoxu: program. Since undertaking 
sudb a study is likely to be a sizeable task, you should consider 
these issues carefully before setting out. 

THE USE OF OUTSIDE RESEARCH GROUPS 

Two basic approaches are available for implementing such a re- 
search study — directing and conducting it within your program ot 
contracting with an outside research group to conduct it. The 
factors to be weighed in choosix^ between these arrangements are 
elaborated in the next ch^ter and,, therefore, will not be reviewed 
here. However, should an outside contractor be your choice, you 
might want to consider whether there are cost advantages, and 
possibly other advantages, in joining with one or more crther treats 
ment programs in your area for the jpurchase of the research 
services. Not only could the fixed costs of developing interviews 
and procedures be shared by several programs, but you also woul^ 
have some comparable data from other programs with which to 
compare year own results. 



* A volume recently published by the National Institute on Drug 
Abuse, Manual for Drug Treatment Program Self -Evaluation , 
provides- a-guide to conducting in-treatment evaluation^studies. 
It can be ordered by writing to the Clearinghouse, National 
Institute on Drug Abuse. ^ 
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with or without the partic^atlon of other programs, you would be 
well advised to establish a written contract with any outside re- 
search unit you migjit use. Obviously such a contract should be 
g)ecific.as to costs, time schedule, and e:q>ected products. You 
will probably aleo want to specify that completed interviews and 
data cards or computer tapes will be turned over to you at the end 
of the contract in case you want to reanalyze the results at a later 
date. If you hop^ to follow the same clients again later, you will 
also want copies of all the records used in locating them for Inter- 
view and a key that will enable you to link the interview to the 
specific person interviewed. At the time of writing the contract, 
you should also make explicit what, if any, ri^ts the contractor 
has to publiBh independently from your data or to identify the re- 
sults as coming from your program. These are all issues whidi 
may prove important to you at a later date and which, therefore, 
should be clarified at the outset. 
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A Range of This chapter provides a brief overview of the considerations 

Decisions fundamental to planning a follow-up study. It outlines the basic 

steps necessary in any such study, and discusses some of the 
secondary problems which the decision-maker will need to con- 
sider in formulating the research design and in mapping out the 
best use of available resources. 

These considerations vary in complexity. They range from de- 
cisions about such matters as who should collect the foUow-tgi 
data and from whom to collect it, to decisions about what kinds of 
data will be needed and what data collection methods should be 
used. Later chapters will deal with most of these questions in 
greater detail. The present concern is to provide a general in- 
troduction to them, and show how each decision can affect the 
others. 
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STEPS IN PLANNING A FOLLOW-UP STUDY 



1. DeiFihing the Research Problem 

Au agency may begin with a general question like 'Hvhat happens to 
our clients after they are discharged from treatment? but suph 
a question will be too general to.guide the research^. Research. . 
questions must be specific. They can be simfile: for example, 
J'do the clients have any suggestions as to how cur program could 
be improved? " or '^ow many are using heroin again? Or they 
may be complex: for example, "do clients on methadone main- 
tenance show less criminal behavior than those treated in a drug 
free program? or, using drug use, crime and ebploymeht as 
criteria, "are clients more improved after 'treatment than they 
would have been without treatment? " It will bs seen in later 
chapters that it may be extremely difficult to obtain clear answers 
to these latter, more complex questions* 

2. Defining the Audience 

It is valuable to analyze who will actually use the answers to the 
research questions, and for what. At one extreme, the intention 
^may be^ for .the_agency^its„eltto..UBa.flLe,.answerfi.. .Eor example, 
the agency may wish to decide whether more effort sLould be 
made to help clients find employment. In such a case, the de- 
cision-maker can feel free to define^what eyidence he will con- 
sider sufficient to answer such a question for the intended pur- 
poses. The decision may be that nof many clpntg need to be fol- 
lowed to provide an answer sa'ficiently definite for agency use. 
At the other extreme, if the audience for which the research 
answers are intended is the scientific conamunity at large, or a 
funding agency, greater accuracy of estimation may be required 
and a much more rigorous research design may be needed, if 
credit is to be given to the findings. 

3. Determining What to Measure 

The research questions to be addressed in the study should be 
stated at a sufficient level of specificity so that the variables of 
rele\ance can be chosen. A concept such as "improvement" is 
not adequate, unless the dimensions on which improvement is to 
be measured are also defined. 

Researchers generally speak of independent , dependent , and con- 
trol variables. The dependent variables are outcomes which are 
to be predicted or explained in the research* The independent 
variables are those which the researcher thinks may predict or 
o:q)lain the dependent variables. By contrast, control variables 
are most frequently conditional; they are thought of as things 
which, if controlled, may make a difference in the relationships, 
discovered between the independent and dependent variables. As 
an example, in a drug foUow-i^ study, the dependent variable 
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might be employment, and an independent variable might be the 
length of treatment. If you then asked whether the relationship 
betv/een these two variables differed for clients of different ages, 
age would be a control variable. Controlling for a third variable, 
like age, may cause an observed relationship to intensify, to 
diminish, or to be more ^parent in some subgroups (like older 
clients) than in others. 

Baseline and You will also see references in the literature to baseline variables . 

Treatment Variables treatment variables and post-treatment variables . Baseline var- 
iables are those which describe the client prior to or at the mo- 
- ment of entering treatment. These are often selected as control 

variables. Treatment variables describe the treatment he re- 
ceived, and are often the independent variables. Post-treatment 
variables > of course, are variables wiih a later time reference. 

Post-treatment variables can be divided into two categories: first, 
o utcome variables , those the project intends to use as descriptions 
of adjustment or criteria of success, such as employment, crim- 
inal behavior and drug use; and second, other variables to descrtt)e 
post-treatment conditions or experiences which may help to explain 
the outcome variables, such as the cost or difficulty of obtaining 
drugs, * 

It is important to define these variables very early in the plans for 
a research study. The baseline and treatment variables may al- 
ready exist in client records, and'fhese data can be abstracted 
and used as predictors of outcomes. If such data are not available 
in existing client records, they will have to be obtained, either at 
intake or in the follow-up. However, il is greatly preferable to 
have the baseline and treatment variables measured before the 
follow-up actually commences. If the baseline and treatment 
variables are not measured until the follow-up commences, it is 
possible that the outcome might influence the client^s answers 
about what he was like before treatment or what the treatment 
experience itself was like, 

4* Deciding on the Desired Degree of Accuracy 

It is imperative to evaluate how costly errors would be. Suppose 
your research objective is only to find out whether there may be a 
need for more job counseling and job placemer.t activities in your 
agency. Suppose further that a small sample is followed to <A)tain 
the answer, and it turns out that 50 per cent of the respondents re- 
port difficulty in getting a job. You would not be justified in con- 
cluding that exactly 50 per cent of all your clients had such diffi- 
culties, but you would know that a fairly large proportion are 
having them. You may not care 'whether the exact number is 40 
per cent or 60 per cent. Therefore, for the purposes of your 
decision, you may consider this enough information on which to 
make a decision to reallocate resources to provide more help in 
job counselii^. 
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At the other extreme, suppose an agency offers two kinds of treats 
ment, and wishes to report to the scientific community which.is 
better. Or the agency may even wish t o consider terminating the 
less effective treatment and doubling ^che more effective kind. Such 
conclusions-and decisions are not to be taken li^tly, and you 
would need more careful procedures to verify their correctness. 


•i 


Assunxlng, for example, that the effectiveness of the two treat- 
ments will be judged In terms of the percentage of clients using 
drugs after t*^eatment, it is necessary to decide how large the 
percentage difference between them must be before it will be con- 
sidered a real difference. The quality of the answer depends, 
emong other things, on sample size. Indeed, some agencies may 
find that the sample size required for statistical reliability is 
larger than the number of clients they have in fact treated. An 
agency ml^t well find that it could ncA achieve the accuracy it ^ ' 
would demand before accepting an answer to Its original research 
question. la such a case It would be well advised to discard that 
question and develop easier questions. 




The more Important the decisions that may be based on the study, 
the more important it becomes that its findings are scientifically 
sound. If iStaff af e tb'be allocated on the Basis of Istudy 
if a request for funds is to be based on them, or if treatment com- 
ponents are to be selected or modified, then the need for rigorous 
research procedures — a scientific sample, a higji completion rate, 
reliable and valid data, and careful analysis of the data — becomes 
correspondingly greater. 


5. Salacting the Method of Data Gathering 


Checking 
Records 


Follow-up studies can be limited to checking your own records, 
police records, or vital statistics for Information they already 
contain on ex-clients, to see for instance if they have re-entered 
treatment, been arrested, or died. 


Questionnaires 


Data can also be collected by mailing questionnaires to ex-clients, 
but for a number of reasons this will rarely be an acceptable pro- 
cedure for follow-ups of drug users. As Chapter 5 will show, the 
mailed questionnaire approach risks exposing to others who may 
open the mail the fact that the client was a drug user. In addition, 
the response rate to mail questionnaires is usually low. Finally, 
there are technical problems in designing questionnaires, and 
agency staff often will not possess the expertise in questionnaire 
deslg;n that they may have in interviewing. 


Interviews 


For these reasons interviews will usually be the best choice* for 
data collection. You have a choice between two types of Interviews: 
xmstructured ones, in which the intervj'^wer guides the conversation 
according to a general understanding c ae areas in which infor- 
mation is sought; and structured ones, in which fixed questions 
are asked in a fixed order (with some allowance for sk^ping 
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questions depending on iinswers to prior questions). Generally the 
structured interview wi'll be the preferable choice. The fixed 
questions it contains muy have either a number of fixed responses 
from \^ich the respondent chooses, or they may be open-ended, 
with a few lines provided for writing down the respondent's reply 
verbatim. In Chapter 4 the advantages of each type will be ex- 
plored further. 



6. Selecting a Research Design 

Experiments The agency might elect to design a true experiment, in which 

clients are randomly assigned to Treatment A and Treatment B, 
of to tfeaffiLent and ho treatment. The experiment provides the 
clearest possible answer to research questions because you will 
know that neither the clients' choice of treatment nor the staff's 
assignment of individuals to treatment have contributed to your 
results. But Chapter 3 will show that ior ethical and practical 
reasons the e3q)erimeht will rarely be a feasible choice-— which 
means it may be impossible to answer some research questions as 
definitively as you would like. 



The Need to- At-the heart of-researchjp whether e3q)erimental'or*not| is-com- 

Make parison-Hbetween a treatment group and a control group in the 

Comparisons simplest case. A follow-up study which merely describes some 

ex-clients may be of value in providing the staff with a realistic 
view of the outcomes which their clients are experiencing, but will 
tell nothing about the importance of the treatment, or aspects of 
treatment, in effectuatii^ these outcomes. Effects can only be 
assessed when comparison is possible^ For example, there may 
be con:^)arisons of two or more treatment groups, comparisons of 
a treatment group ^s baseline and outcome measures, or compar- 
isons of the outcome for one agency's clients and those of siniilar 
agencies. A wide variety of nonexperlmental research designs is 
available to assist in making such compairisons, and the most 
conmion of these are discussed in Chapter 3. 



7. Defining the Poputations.to be Studied 

The populations under study should be clearly defined at the outset. 
For example, if you are interested in whether clients who complete 
treatment turn out better than those who do not complete treatment, 
it is important to decide what you mean by 'Completed treatment, 
Thus, you may want to specify some mlnlTnum time in treatment, 
say six months or twelve months, as the defining characteristic 
for that population. Whether it is easy or difficult to define and 
identify the population will depend to a large extent on how good or 
how poor the agency records are. Moreover, if a. comparison 
groiqp is to be used in the design, as discussed in Chapter 3, its 
population also needs to be defined and identified, because a sample 
for interviewing will be drawn from that group too. 
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Such a comparison group mi^t be drawn from the population pf 
those persons who entered treatment but dropped out before com-* 
pleting it, or from the population of those who inquired about or 
applied for treatment, but never entered it. But again, clear 
definitions will be necessaiy. For example, how are "inquiries'* 
and "entry Into treatment" to be defined? It is also advisable to 
consider whether auch persons can actually be identified, and 
unambiguously assigned to one of these categories. 



Listing the In either case, once the target populations have been defined and 

Populations identified, a list should be made of every individual within them . 

It is these lists from which the sample will be chosen by raxKlom 

selectiohi, 



8. Selecting a Sample and Designing the interview 

If the number of clients \^o have left your agency is small, you 
may decide to interview all of them. Usually, however, a sample 
is chosen. It is much less difficult and e:q)ensive to use a isamplei 
and the answers to the research questions can be as definite am' 
as valuable whm based on a sample as when based on a total 
population~'topulation"here being assumed to be all former 
clients noionger in^treatment; — 



Chaptor 3 will describe in some detail how such a sample can be 
drawn from the population, using raxidom sampling procedures 
which are intended to yield a sample which will be representative 
of the larger population from which it is drawn. 

Designing the Next you will choose the variables referred to above: the depend- 

Interview ent, independent and control variables After that the interview 

must be designed to measure those variables accurately. The set 
of directions for giving an interview—including the questions to be 
asked and instructions about vHxen questions can be omitted— is 
called the interview schedule . Measurement will be discussed in 
Chapter 4. Here it is sufficient to note that developing questions 
that are good measures of your variables is not a one-step pro- 
cedure. E:q)erienced researchers pretoj3t.theii:^questions . on sev- 
eral persons (chosen to be as similar as possible to those who will 
be in the sample). They evaluate the questions for clarity, accept- 
ability, and whether they are really getting at the variables the 
rese^chers had in mind. They then revise and pretest the ques- 
tions agaLi, repeating this process many times before settling on 
the final forr^ of their questions. 
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ArittelpSatlhg When. designing, the interview schedule, you must know ahead of 

tfe Findings time how the data will be analyzed* One reason is devious: the 

yariables needed for analysis will hot be available unless the inter-^ 
view schedule is designed to obtain them* The researcher should 
have ih-mind not only the central comparisons to be made, but 
also,, and more importantly, possible alternative explanations for 
the findings that may result* As one example, the study may find 
that post-treatnient drug use is less-for those clients-who-have— — 
been in treatment longer* It would be tempting to conclude from 
these residts that treatment had worked* But a critic could sug- 
gest that those who use drugs less after treatanent may have used 
them less before treatment, and for some reason remained in 
treatment Ibnger* The researcher could not test the validity of 
this alternative explanation for the results if the need to have data 
on drug use prior to treatment had not been anticipated* 



When the detailed research procedures have been drawn tqp, the 
planning stage of the .project is almost completed* Not quite com- 
pleted, because it is only at this point that detailed estimates of 
time and cost can be made* As a practical matter, the decision 
as to whether or not the research will be dene , at all depends 
largely on these estimates* The subject of cost is important 
enou^ to be dealt with in a separate section later in this ch^ter* 
But it may be noted here that*it is not.unusual to complete a de- 
tailed research design and m^e a cost estimate based on it, only 
to decide that the cost is too great* In such a case revisions in ttie 
plan naay be possible—perhaps simpler and easier research- 
questions, perhaps a smaller sample, or perhaps a shorter 
interview* 

But when a research design is completed and its cost is foimd to be 
acceptable that a decision to do the follow-up is made, the re- 
maining steps of the project are: 

10. Collecting the Data 

(See Chapters 5, 6, 7, and 8*) 

11. Processing and Analyzing the Data 

(See Chapters 9 and 10*) 

12. Writing the Research Report 

(See Chapter 11* ) 

Why Have a The need for a written research report cannot be overemphasized* 

Written Report? Indeed, the research project is not actually complete until a report 
is written* Sometimes only a few staff members are involved in 
tihe project, and they may be the same staff who will make whatever 
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use is to be made of its findings. Nevertheless, it is not safe to 
assume that no report is necessary because ttiey ^ready know the 
results. It is always valuable to have a formal research report, 
in writing. One reason is that the process of writing clarifies 
ideas. It is not always easy to describe findings precisely, and 
specify the limitations that may apply to them, but the very diffi- 
culty of the task is an indication of its importance. Inferences 
from the study may be vague before they are put in writing, and 
may even differ among staff members, who will never discover 
the degree of their divergence unless they try to agree on a 
written draft. Another reason to. develop a written report is that 
it makes possible comparisons between flie different parts of the 
data; it may even uncover contradictions in the data, or incon- 
sistencies which need to be resolved. Finally, of course, the 
study can make no contribution to scientific Imowledge uxiless and 
untU it is in a form which can be made available to others. 

WHO SHOULD CONDUCT THE STUDY 

Assuming availability of the necessary resources, programs can 
elect to conduct the follow-up survey themselves, or they can.draw 
upon evaluation teams available in their communities. There are 
advantages and disadvantages in both ^preaches. 

Internal Survey In some studies, it is likely that the existing staff of the agency 
Staff can do a better job of obtaining the foilow-i?) data from research 

subjects than could outside e^evts, provid^g that the time needed 
for the follow-up is made available for them. The counselor who 
has worked with the ex-client may be able to establish contact more 
easily than a stranger could. Moreover, the counselor 's'feiowledge 
of the ex-client's historj' provides a check on the information given 
at follow-up. This would not be available to a new interviewer 
hired only for the foUow-tp. 

External Survey in other studies, external survey staff may be preferred. The de- 
Staff cision as to whether a follow-iQ) should be conducted by staff out- 
side or within the program will be shaped by several considerations. 
One consideration is whether the respohdehts* answers are likely 
to be as honest to treatment staff whom they may know and wish to 
please, as they would to strangers. Another is the potential threat, 
real or perceived, to treatment staff. Where data are sought 
simply to see whether modifications in a treatment program may be 
irdicated, no threat of any kind maybe involved for the treatment 
staff who might collect the data. But when the program is to be 
studied by an outside evaluation group, or when two treatments are 
being compared, the situation may be quite different Conceivably 
one treatment would be discontinued as the result of the follow-up, 
and jobs would be lost. With so much depending on the findings, it 
would be unrealistic to expect treatment personnel to be fiiily 
objective in data collection. 
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Subtle Threats to 
treatment Staff 



Corfsider Outside 
Interviewers 



Minimizing the 

Risks.of 

Subjectivity 



The Audience As 
a Factor in Staff 
Selection 



Even "When no Aire at of such magnitude is involved, there will in- 
evitably be more subtle threats. Most therapists or counselors 
are able to sustain the frequent frustrations in their jobs because 
they are convinced of the value of their work, for at least some of 
their clients some of the time. It is not easy for them to face the 
possibility of follow-up findings which might lead to the conclusion 
that &ey had been wasting their time for years. They may well 
have felt that their kind of treatment is preferable to a secohdtkind, 
and now risk learning that the second was really more effective,^ 

Even if there is no risk at all of deliberate, conscious distortion of 
findings to support the preferred^treatment, there will. always be 
the risk of unconscious efforts, to manipulate the findings. This: 
unconscious bias may surface in any of a nuinber of ways: In 
somewhat stronger efforts to elicit good results fronx clients who 
received the preferred treatment,, or in stronger efforts to locate 
the clients from the preferred progr^^^ 
have "stayed clean. " 

When the data-collector has a stake in the findings, for whatever 
reason, the question should always be raised v;hether that person 
should be used as a^data collector. The possibility of using outside 
interviewers, to whom one set of findings is no :mpre attractive, 
than another set, shbuld clearly be given careful consideration, 
(Chapter 7 will discuss the advisability of using.an interviewer 
unknown to the client* ) 

If this is not feasible, for budgetary or other reasons, some pre- 
cautipiis can be t^en to minimize the risks of using staff with a 
stake in the findings, A fixed interview tbraaat wiU'be somewhat 
more effective in avoiding bias than an unstructured interview, 
which allows the interviewer great latitude in what he asks. Even 
then, it should be kept in mind that the: interview is never com- 
pletely safe from bias— the tone of voice, or non-verbal cues, can 
elicit quite different responses to what seems on paper to be the 
same question. 

Another method of minimizing conscious or imconscious bias in the 
work of internal staff is to have data collected by staff members 
who have the least stake in the results. Administrative staff, for 
example, might be useful in this regard, or coimselcrs might be 
assigned to follow former clients who were not their own clients. 

Just as threat to treatment staff is a consideration in the decision 
whether to use internal or external survey staff, so too is the 
nature of the audience for which that survey is intended. If the 
agency executives will base decisions about changes in program on 
the follow-up findings, they may prefer to have the follow-up done 
by their own staff. Presumably they know and trust their staff, 
and it may well be that recommendations from them would, and 
should, carry more weight than those made by an outside agency. 
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But if fixe data are intended for a funding agency or a legislative 
body, or as a report to a professional journal, the use of agency 
staff for da^ collection becomes much more questionable. It 
pannot be e:q)ected that outsiders will have the same confidence in 
staff dbjectivity that the agency itself mi^t have. In a report for 
such an audience it pec onies necessary to demonstrate that fairly 
rigorous research techniques have been used. In general it may be 
said that if decisions by an outside agency may have an impact on 
the agency ^ose pi-ogram is to be evaluated, it is highly desirable 
to have the evaluation done by an independent research uniti 

Cost But flie cost of an outside evaluation, or other equally cogent con- 

Considerations siderations, may rule this. possibUify outi The choice may be 

between no evaluation at all, or one done by the agency within its ; 

own resources. In iJiis case, in order to havedts flnai report 

accepted, Uie agency should adhere to the principles of research 

des|^ discus£^d^thr6ughout this manual. In fte remainder of this 

ch^'ter, the assufioption ^illtbe that the agency'has declped^to 

conduct its own study; that the study will not be an ongoing one, 

but rather will involve a single follow-up; and that it will Involve 

clients who have already gone through treatment. However, the 

more complicated alternatives of ongoing studies, and olprospec- 

tive studies—in which pre-treatment measures can be designed for ' 

the stu(^y~wlll be treated briefly in later chapters. 



INITIAL STEPS 

The Director It is advisable that one person be appointed as principal investi- 

gator, or director, of the follow-up study. This can be the agency 
executive, if the study is small enou^ in scale and s/he has the 
time to supervise it. But in^any case the time required for directing 
the study should be estimated—generously— and the person selected 
should be freed, as necessary, from other duties. 

Research training and e^erience are.desirable in the investigator, 
but at a mlnimtim this person should have an interest in research, 
and a willin^ess to read and learn from manuals such as this. 
Administrative skills are essential, especially if the study will in- 
volve a number of staff and a sizeable amount of time. 



The Staff 



The Written 
Plan 



If regular staff are employed part-time on the follow-up, there 
should be a clear understanding among them» their supervisors, 
'and the follow-up director as to how much time they will devote to 
the project, ^ at what times. A formal time schedule maybe 
needed. If staff work on the follow-up can be done only on time 
stolen from their regular duties, some tasks will <A»viously be 
executed poorly or not at all. 

It is likely that the appointment of a project director will represent 
only a tentative decision to do a follow-up study, and to use a 
specific method for it. At this point the essential research steps 
described above may have been consideredi but only in general 
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Reviewing Agency 
Records 



Types of Data 
to Collect 



Defining 

Treatment 

Goals 



terms. If so, the first task of the director-- together with any 
other professional staff who will work on the follow-up-- is to 
produce a written research plan which covers in detail the first 
six steps described earlier and at least in general terms the re- 
maining steps. 

The plan must be written, because only thenjs it possible to 
analyze whether all of its parts fit together consistently. Too, it 
will not be possible to draw up a firm work schedule and budget 
(see below) until the research plan has been completed in detail. 
The agency administrator shoidd not give a final go-ahead to the 
study until ttie schedule and budget have been considered. 

Most of the research steps described earlier will be clear enougji 
to guide the project director, who can begin by identifyiog the studly 
goals_and formulating the questions to be answered. It has been; 
noted that these should be stated in terms of y^iables Md relatiotii- 
ships among variables, Tlius, a carefiil review of ti&e exisHiag 
agency records should be made to determine which variables are 
adequately recorded already, and which will require measurement 
in the follow-up. The records may also suggest how the study and 
comparison populations are to be defined, and an early step should 
be the complete listing of those populations, though the samples 
should not yet be selected. This preliminary review of records 
may well suggest some improvements In record-fceeplng that will 
facilitate later follow-i?)s, though not the study how betag designed. 

Similarly, improvements may be possible in the recording of base^ 
line and treatment variables for future studies. But the first 
foUow-iq) problem as such will be to locate the persons to be inter^ 
viewed, and the information needed to locate them should first be 
sought in the agency records (see Chapter 6 for specific examples). 
There is also a second type of data to be located in existing. agency 
records, namely, the baseline and treatment variables. Methods 
for abstracting both types of data from existing agency records 
will be discussed in greater detail below. It shdild again be em- 
phasized that the stud3nQow designed ^ll .hay:e ta .manage with ihe 
data which have been recorded in the past, plus whatever can be 
measured in the foUow-iq) interview. However, the designers of 
the study will have a good deal more freedom In planning for out- 
come variables. 

Follow-up studies of drug users have normally obtained additional . 
data in at least one area, post-treatment use of drugs. Quite ofteiii 
they have also included, as indicators of the effects of treatment, 
such dependent variables as employment and criminal behavior. 
Less often, they have looked at siich variables as interpersonal 
relationships, or the individual's satisfaction with life generally. 

One further preliminary step is advisable at this point In the study. 
Before an agency is ready to study its own effectiveness, a good 
deal of time can profitably be spent in discussions of what an 
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agency means by the "efficacy" of a treatment, and how that can 
be measured. 



"Efficacy" presumably refers to the degree to which the goals of 
treatment have been achieved, so its measurement must eventually 
be based on the identification and definition of these objectives. 
Therefore, if assessing the efficacy of treatment is a major 

goal — and, as mentioned previously, it is one of the most difficult 

goals to attain~then some thought should be given in advance to 
the dimensions on which efficacy can be measured. 

When the goals of the program have been clearly defined, and the 
procedures of the study described in some detail, a work schedule, 
and budget should be drawn up (see below). The sample need not 
be selected yet, but its size should^bje_specified at this point, in 
order to produce a firm work schedule and budget. 

the Pilot Study The pilot study is a small scale study, on perhaps no more than 10 
or 20 ex-clientSi It should use the design of the main study, in- 
corporating all the procedures the latter will require. It therefore 
requires at least a tentative interview schedule. It should involve 
only clients who will not be in the sample of the main study, but 
who are as much like them as possible. A good way to ensure this 
is to select the sample for the main study, and then do the pilot 
study on others not within the sample but within the same population. 

The pilot study gives an opportunity to pretest the interview schedule 
and to revise questions which prove to be unclear. It very oiEten 
points to the need to reduce the number of questions in order to 
keep the total interview time within limits ttie respondents will 
accept. Other benefits include the identification of staff who are 
particularly good at various functions, the development of confi- 
dence in the agency's ability to do a good follow-up j and^the-^ de- 
velopment of some early cost estimates, 

WORK SCHEDULE AND BUDGET 

Planning a In large scale studies it is essential, and even in the smallest it is 

Timetable desirable, to determine early in the planning stage the extent of the 

work to be done and to plan and lay out a timetable with target dates 
for the various phases of the study: definition of the population, 
selection of the sample, abstracting of data from records, updating 
of addresses, locating and interviewing of respondents, editing of 
data, coding, keypunching, verifying, analysis, and preparation of 
the report. It is quite possible that an inexperienced researcher 
will be inaccurate in making time estimates, but even a timetable that 
must be modified later will have some value. 

Ttie Value of a A major advantage of a timetable is that it makes possible an esti- 
Tinaetable mate of the staff time needed to complete the project. A timetable 

will also lead to a listing of all the things that need to be done, and 
thus open up at an early stage the questions of how they are to be 
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doae, highlighting some areas where e3q)ert consultation may be 
needed, or where special training may be advisable for staff who 
may have to perform functions with which they are not familiar. 
The timetable will also help to keep the progress of *he project on 
track. At a minimum it will call to the attention of the project 
director that a problem has arisen, through the delays it causes. 

Developing a This breakdown of the work to be done, and the approximate time 

Budget in needed to do it, will also be essential in developing a budget for 

Man-Hours the project. Good follow-up studies will rarely be cheap. They 

may not require additional funds, but by diverting staff time from 
other duties they do involve hidden costs which must be evaluated 
by the agency administrator before approving the project. In- 
experienced researchers do not always fully appreciate that several 
man-years of work may be required in even a small project. The 
administrator should determine in advance that these can be spared^ 
and calculate how. the^normal duties of staff-will be-covered during 
the time they spend on the project. Such considerations may lead, 
in some cases, to a decision that the agency caimot afford to do the 
project, or that it,must be scaled down in size. But this would be 
better than to invest a great deal of thought and many months of 
work in an overly ambitious study which later might have to be 
abandoned or drastically scaled down in such a way as to greatly 
reduce the usefulness of the results. 



Costs Associated 
with Telephone 
Foliow-Ups 



Follow-up studies can vary so widely in aims, methods and scope 
that it is difficult to be specific about costs. The following general 
suggestions can be made, based on the e^erience of many 
researchers. 



Costs Associated 
with Mail 
Questionnaires 
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Telephone follow-ups are generally quick and inexpensive. The 
cost of leasing an extra line or of purchasing more extensive serv- 
ice can be explored. The speed and cheapness of such a study, 
however, will be bought at a high price in terms of its scientific 
value. Those ex-clients who do not have phones will be lost from 
the sample, probably biasing its findings. In addition, telephone 
interviews must usually be shorter and simpler Ihan-face-to-face- 
interviews, so there is a cost in lost information. Finally, as 
Chsqpter 5 will discuss, it can be so difficult to maintain confi- 
dentiality of information when the telephone is used that ethical 
considerations may preclude this approach completely. 

Mail questionnaries are also relatively inexpensive. Again, how- 
ever, there is a serious question of maintaining confidentiality if 
mall is used. There are also technical problems in questionnaire 
construction for which consultation may be needed. It is normally 
necessary to use repeat mailings — at le^t once, often two or 
three times— to those who do not return the questionnaire. Each of 
these repeat mailings must contair. copies of the questionnaire, 
since the first may have been lost or ttirown away. It will therefore 
be necessary to print two or three questionnaires per person in the 
sample, and it will normally be cheaper to have these all printed at 
the start. 
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-Costs Associated 
with Personal 
interviews 



Costs Associated 
with Locating 
Respondents 



Mail questionnaires also involve added clerical costs to keep track 
.of which questionnaires have been returned, and to mail the second 
and subsequent waves to those who have not returned the question-! 
nalre. Stamped return envelopes will be needed with each mailing. 
Since several weeks have to be allowed for replies after each 
mailing, the completion of a mail survey could take several months. 

The most conamon problem with mailed questionnaires is a low rer 
turn rate. No matter how good* the sample may be, it will be im- 
possible to draw statistically justified inferences if the return rate 
is low. For this reason a mall questionnaire will usually be a poor 
choice of method unless there is a way to find and interview at 
least a sample of those who do not return questionnaires p or unless 
the research question is one that need not be answered with great 
accuracy. 

Eaceriorface.intervie^s^ing^has, s^eKexalMvaute^ it facilitates^ 
confidentiality; it assures that the right person Is answering; It 
permits more questions, and more complex questions; and it per- 
mits probes where answers are unclear. But it is the most costly 
research method in terms of time and money. 

In a very large scale follow-up, in which 500 or more ex-clients 
are to be interviewed over a large geographical area, and some 20 
or more interviewers are to be employed to do the interviews, the 
agency prc*ably would be wise to contract the entire project out to 
a professional research organization. The problems of recruitingj^ 
training and supervising the interviewers would simply be too great 
for an agency which did not have full-time staff experienced in 
these functions. Even for smaller studies, in which several hun- 
dred ex-clients are to be followed, a contract with an ejqperienced 
research organization should be considered: extra Interviewers 
would probably have to be employed anyway in such a case. 

However, for the remainder of this chsgoter it will be assumed that 
the sample will be 300 or less in size, and that interviews are to 
be done by existing staff of the agency,, perhapa supplemented by 
one or two extra persons brou^t in to help temporarily. Under 
such circumstances the major cost to the agency will be the time 
its own staff will devote to the follow-up. A good rule of thumb is 
that everything will require considerably more time than one would 
expect. 

Based, on the experience of previous researchers, the time reqvlred 
for the interview itself v;ill be much less than the time it takes to 
locate the ex-clients in the sample, and to arrange for the interview. 
(Chapter 6 discusses in some detail the problems in locating re-* 
spondents). Only the pilot study mentioned earlier will provide good 
estimates of these time requirements. In addition, interviews done 
In the city where an agency is located will provide estimates of how 
large a percentage have remained in the city, and how long It takes 
to locate and interview them. It will obviously take much longer, 
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and cost more in travel e3q)enses, to interview those respondents 
who have moved to other cities. 



A very rough estimate, which could vary widely in different situa- 
tions, is that it could take one man-year to locate and interview a 
sample of 200 ex-clients, assuming these were followed to wherever 
fhey might happen to be, and assuming that a completion rate of 
85 per-cent or more is sou^t. The time requirement would be 
less if the follow-up were done soon after the completion of treat- 
ment, since fewer would have moved. It should be noted that the 
estimated man-year could not be collapsed into one. month . by using 
a dozen interviewers: there will inevitably be delays in finding 
leads to ex-clients, and there will always be some whom it will 
take months to locate. 

Travel Costs Travel costs can be an important element in the overall cost esti- 

mates. If they are too burdensome, you may need to con9ider re- 
defining the population to be studied, and therefpre the population 
about which inferences can be drawn from follow-up findings. For 
example, the study may need to be confined to those ex-clients who 
have remained in the city, or within a fairly short distance of the 
city. 

Clerical Costs It should also be recognized that an appreciable amount of clerical 

time, and time of the study director, will be needed to maintain 
records on the steps taken to trace the persons in &e sample and 
on the attempts made to interview them, as well as to process the 
data obtained in interviews. 

Chart 1 outlines the various cost items which, at a minimum, 
should be considered in constructing a budget. When the best pos- 
sible estimates of time and money costs have been 'made, the 
project director and tihie agency administrator should realize that 
they are only estimates, and that unforeseen contingencies may in- 
crease the costs. The study should not be approvisd unless it is 
well within the agency's resources. 

The costs, of course, must be judged in light of the value of ex- 
pected findings. It is at this point that an agency may discover that 
the questions it most wants to answer — 'How good is our treatment 
program? 'How much are our clients helped? "—cannot be 
answered as a practical matter because the research design needed 
for such questions cannot be approximated, or because the costs 
are far too great, or because the needed time cannot be spared 
from normal duties. Such a conclusion is, of course, disappointing. 
But it is far better to choose a different question to ask, or to use 
a smaller sample and thus accept a less precise answer, than to 
go ahead with an unrealistic proposal in the hope that some miracle 
will occur. Consultation can be especially helpful at the point when 
such decisions must be made (see below). 



Adjusting the 
Study to Resources 
Available 
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Research Costs To Be Considered 



Personnel Costs 

Research Investigator(s) - general 
Any additional, staff time required for: 

Coding answers 
Keypunching answers 
Data processing 

Search of agency records (If any), 

Interviewers 
Secretarial siq)poi't 
Consultants 

Non-Personnel Costs 

Interviewer travel costs 
Printing or duplicating 

Questionnaire or interviews 

Postcards, return envelopes, etc, (if any) 

Final report 

Xeroxing 

Postage 
Telephone 
Computer Time 

payment to Respondents (if any) 
Office Supplies 
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The Lists of the 
Populations for 
Study 



The Control 
File 



ADMINISTRATIVE AND RESEARCH RECORDS 

Assuming that the research plan has been approved, the next steps 
to be taken by the foUow-iq) director can be examined in terms of 
the records needed for the efficient coquet of the study. These 
records need not be extensive, but a few will be essential. 

The first requirement is a complete list of all those clients who 
were eligible to be selected for the sample, with a written.descrip- 
tion of how eligibility was defined. The iame kind of list is needefl 
for control or comparison groiq)S if these are used. Ch^ter 3 
will discuss some of the ways in which a sample can be selected 
from a population. A clear record should also be kept of exactly 
how each sample was drawn from its population. 

Once the sample has been selected, the first record to be estab- 
lished is' a card or folder for eachjndiyiduai within the sample, 
selected. This will serve as-a master control file; 

In any follow-up study,, as mentioned earlier, the existing agency 
records of the ex-clients selected for the sample are examined for 
any information which will help tc locate the respondent, and to 
confirm his identity as the correct person to be interviewedr-items 
like addresses, birthdate, nickiiames or aliases, social security 
number, names and addresses of relatives and friends who mi^t 
know his current location, and any other descriptive Information. 
These data should be recorded on a "search sheet" to be used by 
the persons who attempt to locate the subject. 

The purpose^of the^control file is to reveal at a glance what has 
been done and what remains to be done to complete the foUow-ig). 
At a minimum, the control file should record the following: 
(1) what has been done to trace the respondent, the leads that 
have been exhausted and the new leads that have been found; (2) the 
efforts to interview him, and their results; (3) whether an interview 
has been completed; (4) whether the interview has been edited for 
completeness and clarity, including any return of a case to the 
interviewer for further contacts to get missing Information; 
(5) whether the coding of data has been completed; (6) whether 
coding has been checked for accurkoy; and (7) whether the data 
have been transferred to IBM cards or the equivalent for entry 
into the data bank for analysis. Similar steps In retrieving and 
coding information from treatment records and Information from 
police records or ,vital statistics should be listed and checked off 
on the control card. 

The control form should provide space for dates to indicate when 
each step is completed, and space to describe the reasons for any 
difficulties and ^hat is to be done about them. In general, the 
simpler the form the better, but it must contain enough information 
so that the project director can quickly review the status of all 
cases. This will make possible periodic checks to see i£ the project 
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The Form for 
Recording 
Baseiihe and 
Trekment 
Variables 



Records of the 

Declslon-Malcing 

Process 



timetable is being met, and to identify any problem areas that may 
need special attention. 

As mentioned previously, another kind of data to be abstracted 
from the agency records consists of the baseline and treatment 
variables that will be used in the data analysis stage. If these 
are very few in number, they can be included on the control card; 
but normally it will be best to design a separate form for recording 
these variables. They should never be entered on the interview 
schedule, because they should not be available to the interviewer 
at the time of interview. 

Research events and decisions should be recorded in writing, as 
they occur, throughout the entire research process. There are 
literally scores of problems to be faced^aad decisions to be made 
during the research process, and it is amazing how quickly you 
can forget which.decisions, were made, and why. Since some 
procedures may need to be repeated later* and since all should be 
in the final report, a careful record of each of these decisions 
should be preserved. 

There is a second, less obvious, reason.for recording the early 
decision-making about any research project. This is that the re- 
searchers begin a project with many questions in mind, and grad- 
ually formulate answers to them as the data come in. They become 
so familiar with the project that the answers seem obvious aiid the 
questions seem hardly worth mentioning when the report is written. 
But the original questions remain just as interesting to the rest of 
the world, who have not seen the data come in. The researchers 
can use their early written records to recapture that simpler level 
at which the written research report should begin. 



Technical 
Consultation 



Legal Consultation 



USE OF CONSULTANTS 

Consultation with "experts" may be useful at almost any stage in 
the research, process. It comes close to being essential at one 
point, when the research plan.has been.developed and committed to 
writing, and the agency administrator is about to decide whether or 
not to approve it. A consultant can be helpful at this point in at 
least three ways: 

(1) To review the plan from a technical research viewpoint. If 
there are any serious flaws in the design, this is the time to find 
them. A consultant may also be able to suggest less expensive or 
more efficient ways of handling some problems. 

(2) To review the plan for legal and ethical problems. A follow-up 
study is research on human subjects, and automatically involves 
risks for those subjects in that damaging information about them 
may be divulged. The legal and ethical requirements for such re- 
search have changed rapidly in recent years. Unless an agency is 
familiar with these requirements, and has existing institutional 
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arrangements to meet them, it is not merely desirable, but es- 
sentia that it secure consultation in this area. 



What KInd.of 
Consultants? 



Help with (3) To assist in preparing a Request For Proposal. If contracting 

Request for with a research organization to do the follow-up is under consider- 

Propo^l ation, consultation on preparing a Request For Proposal is indicated. 

This need not be discussed in detail, since the assumption here has 
been that the agency will not choose this option. If it did do so, it 
should bear in mind that there would be problems in preparing a 
technically adequate RFP, and in evaluating the ability of potential- 
contractors to find hard -to-locate subjects. The cost of consulta- 
tion would be minor by comparison with the cost of such a contract. 

But an agency administrator may well ask: what kind of everts 
are needed, where can they be found, and how much will they cost? 

Few researchers have conducted follow-up studies of drug useM to 
date, biit the huinber is growing. There are more who have directed 
foil ow-i^ studies of other populations, including alcoholics, persons 
with mental health problems and persons treated for physical ill- 
nesses. The ejqperience of such researchers will be directly 
relevant, with some allowance for their lack of familiarity with 
drug users and the drug subculture. There are many more who 
have never done follow-up studies, but are experts in research 
design. Such potential consultants are to be found in the profes- 
sional institutes for survey research, in several agencies at all 
levels of government, and in universities, particularly in their 
medical schools and social science deparhnents. 

One possible source of help, either throu^ its own staff or through 
its knowledge of others with relevant e:fq)erience, is the Single State 
Agency. Indeed, advising them of the study may be desirable for 
another reason: in at least one state, the Single State Agency must 
approve the follow-up before it may be undertaken. The funding 
agency may also be a source of help. In addition, the National 
Institute on Drug Abuse, and staff in the Regional Offices of the 
Department of H. E. W. , while limited in the direct staff help they 
can provide, may be able to identify local sources of consultation. 

The Cost of Consultation costs money, but not necessarily very much. For only 

Consultation a few himdred dollars—perhaps less if no travel is involved—an 

agency can buy a day or two of a consultant's time. This should be 
done only after the agency has completed most of its own plaimlng 
so that it can raise specific questions and give the consultant some- 
thing concrete to react to. To go to a, consultant with a general 
question, like "We would like to do a follow-up study. How do we 
do it?", would be a waste of time for both parties. But if the 
agency has used .a manual like this one, and has done its homework 
before approaching a consultant, it can e5qpect^t6 get reat help. 



Finding 
Consultants 
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Another point in the research cycle at which a consultant may be 
of particular value is at the reporting stage. Once a first draft of 
the final report is completed, it may prove useful to get the 
opinion of an e3q)erienced researcher regarding the analyses and 
deductions it contains. 
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Designing a research study is perhaps the most critical step in the 
research process.^ Without a good design, the results of a study 
will De hard to interpret and its conclusion less than convincing. 
For these reasons, careful statements not only of the study design 
but also of the sampling design are .prerequisites to actual data 
gathering. Such statements are also a prerequisite to funding 
applications and should be available to consultants emploj'ed to help 
with the study. Clearly, faulty design features are easier to correct 
at an early stage than after the data have been gathered and analysis 
has begun. 

Designing any research study requires careful advance planning. 
The first step is to specify what that study is about. On the surface 
this seems easy, but in practice it is often difficult. It is necessary 
to specify at the beginning of a study precisely what questions are 
to be addressed, and to design the research in such a way that it 
will provide answers to these questions. 
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This manual is addressed primarily to those interested in reducing 
clients* drug use and the negative consequences of that use. 
Studying other goals of treatment agencies, such as changing com- 
muQity attitudes toward drug users or reducing crime among userp 
not in treatment, would require different research designs. Fur- 
ther discussion of designs aimed at such goals will be found in 
Appendix A. 



STUDY DESIGNS 

Assuming that a clear specification of the sttdy^s objectives has 
been made, as discussed in Chapter 2, the next step is to choose 
the research design most appropriate for achieving these objectives. 
In almost every case, developing a research design will require a 
number of compromises calculated to strike a balance between 
what those doing the study would like to learn and what the available 
resources will enable them to do. Since , no one study design will 
answer all the questions that programs typically will-^ want t^ pursue, 
the design chosen should deal with the more important questions 
while making the most efficient e:?qQi.enditure of research effort* - 

This discussion presents a number of common designs and shows 
the kinds of questions each can answer. It begins with ttie .e3q>eri- 
mental design, wherein ejqperimental and control girot5)s have be 'm 
selected at random, and it ends with some coihments on what is 
perhaps the simplest design of all—the case study. In faneral, it 
may be said that the more a design resenables an experiment, fee 
greater the confidence one can have in the study's results; Such 
studies, however, require advance planrdng, and may raise diffi- 
culties of an ethical, legal, and technical nature. Therefore, it is 
unlikely that many programs will be able to adopt one of the earlier 
designs discussed here, particularly the true e3q)erimental design* 
However, it is useful to be familiar with these designs in order to 
better understand the strengths and limitations of the later ones. 



Random Assignment 
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THE EXPERIMENTAL DESIGN 

The e^qperimental study design, \^ich includes e:q)erimental and 
control groups chosen at random, is a powerful one. The investi- 
gator randomly assigns each subject to either the e^qperimental or 
control group. Random assignment means that each subject has 
the same probability of being picked for either group. 

After assigning the subjects to experimental and control groups 
(by flipping a coin or using a random number table), the investigator 
next measures specific characteristics of the subjects, such as age, 
sex, and drug e^qDorience. The final step in the experiment is that 
the investigator introduces a unique e^erimentai condition— such 
as a specific treatment —to the e:q)erimental group of subjects but 
not to the control group. By measuring the differences betvveen the 
pre- and post-e:qperlmental characteristics of the e3q)erimental and 
control subjects, the investigator can ascertain the effects of the 
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e:q)erimental condition with great precision. Tliis can be done be-r 
cause all other effects have been randomly distributed between the 
two groups, 

the classical e^qperlment is best suited for studies in \^ich the 
researcher has specific, easily definable, and usually rather 
limited research questions to testj and In which a great deal of 
control over the research procedures can be exercised. Uses of 
this method.in a drug treatment clinic might include comparing the 
effectiveness of different methadone dosage levels, or of iflie pro- 
grain's frequency of taking urine samples. However, the e3q)eri- 
mental design has some limitations for testing the effectiveness of 
a \diole treatment modality or the relative effectiveness of dne 
modality as against another. This is true because treatment 
modalities are actually made up of many treatnient vari^les. If 
one treatment modality is found to be better than the other, the 
researcher may not know which aspects of the better treatment ex^ 
periehce made the difference. 

For example, it may be the case that a charismatic; director of one 
treatment program was responsible for its unusual success. 
Obviously other atten^ts to replicate that program may not have 
such a director and therefore may not e:jqperiehce its success.. 
Similarly, it could be misleading;if an e;:qperiment disclosed that a 
treatment modality had been ineffective as a whole: some elements 
of the program migtt have been very effective, but fliese may 
have been offset by other counterproductive elements, Thiis,. un- 
less the treatment variable is specific and can be isolated from 
other treatment variables, it is prdiably not a good.cmididate for a 
true esgpiariment. 

The classical e^erimental design is also ill-suited for exploratory 
studies or for studies tJiat seek information on a large number of 
in-treatment variables. Since the classical experimental design 
can handle only one treatment variable at a time (or a very limited 
number of such variables), it is not an efficient design for .fiiose 
who wish to ejqjlore numerous aspects of their treatment progrards 
concurrently. For this kind of study, one of the nonexperlmental 
designs discussed below would probably .be more liMfureven thouj^ 
these designs will yield results which are less conclusive than the 
results obtainable from a true e;^eriment. The e3q)eriment also 
presents some practical problems. It requires random assignment 
of clients, or prospective clients, to treatment and no-treatment 
groups. Ethical, legal, and practical restraints will rule this out 
in many programs. 
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NOIM-EXPERIMEIMTAL STUDY DESIGNS 

The research design closest to the classical ejqperiment which moat 
programs can realistically consider is the before-after study wlUi 
comparison groups. This design differs from the experiment in 
that subjects are not assigned at random to experimental and control 
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groups. In the before-after study, comparison groups are used 
instead of randomly selected control groups.. As one example in 
the drug follow-up context, the subjects for study might consist of 
those ex-clients who received a particular kind of treatment, while 
ithe. comparison groups might consist of clients who received 
. . another kind of treatment, or of persons who never entered treat- 
ment at all. 

Similar to the classical experiment, Qiis design calls for before- 
after naeasurement. That is, specific characteristics of the expeiii- 
mehtal and comparison group subjects are measured before and 
after the e2q)erimental subjects have been exposed to the experi- 
mental variable. If these pre-experiment characteristics have 
changed among the experimental but not the comparison group 
si*jects, then the change may be attributed to the experimental 
condition. 

However, without random assignment to experimental and control 
groups, this interpretation must be tentative. For example, if the 
experimental group subjects exhibit a greater reduction in drug use 
than the comparison group, this may be attributable to the experi- 
mental subjects rather than to the effects of treatment. Even though 
experimental and comparison group subjects may have had com- 
parable drug use rates at the beginning of the study, it is possible 
that they could have differed on other dimensions—which could 
have led to the more favorable results for the one group. (Many of 
these differences may even be unknown to the researcher.) Unless 
these differences are randomized between the two groups, as in the 
true experiment, you can never be sure that observed differences 
are due only to the treatment condition. 

Choosing the For this reason, it is important to, choose comparison groups whic)i 

Comparison are as much like the eijqjerimental group as possible. In a study of 

Groups treatment effectiveness, comparison groups might include clients 

who left treatment early, who applied for treatment but never 
actually received it, or who are on a treatment waiting list. Tn 
each of these cases, those in the comparison group are similar in 
that both made application for treatment. But they are not exactly 
alike. For example, people who apply for treatment but never 
receive it may be in more serious legal straits than those who 
actually enter treatment (perhaps they went to prison rather than 
treatment). Moreover, those who leave treatment early may be 
less well-adjusted psychologically than those who complete treat- 
ment, while those on a waiting list may be less heavily involved 
with drugs than those actually admitted to treatment. These 
examples suggest some of the reasons why comparison grorxps can 
only approximate experimental control groups. As a result, re- 
search findings based on differences between comparison groups 
and treatment groups should always be judged cautiously. 

One way to enhance the reliability of the findings is to employ more 
than one comparison group. If it develops that a number of 



£RLC 



Limitations of 
tlie Before-After 
Design 



Panel Studies 



comparison groups exhibit no change during the course of the study 
but that the experimental group does show a change, you can more 
confidently attribute the results of the study to the effects of the 
63qjerimental condition. For example, if program applicants, 
those on a waiting list, and those who left treatment early all 
showed less improvement than those who finished treatment, you 
might be justified in concluding that somettiing about finishing 
treatment was having a positive effect. However, this might be a 
false conclusion if program personnel are admitting those who 
seem most likely to succeed in the first place. 

It may be concluded that the before-after design using comparison 
groups shares some problems with the classical experiment while- 
having additional problems of its own. Like the classical e^qjerir 
ment, it has limitations for studying "whole" programs when only 
one or two programs are included in the study. In addition, it 
suffers because the comparison and experimental subjects are not 
randomly assigned. (The limitations of non-random selection of 
clients into the various groups being compared are discussed 
furttier in Chapter 10.) Nevertheless, this design does avoid some 
of the ethical, legal, and logistical problems associated with random 
assignment, and for that reason it will probably be a more feasible 
study design for many programs. 

One point deserves re-emphasis: the before-after design with 
comparison groups, like tiie classical experiment, calls for multi- 
ple measurements: both the experimental and the control subjects 
must be measured twice—once before the experimental group enters 
treatment, and again after the experimental grouo has finished treat- 
ment. Unfortunately, such prior measurement is not always possible 
in follow-up studies. Most programs have intake data on all- clients 
which were gathered at the time of program admission, but these data 
are not always sufficient for reliable research analysis. 

There are at least two reasons why such data may be insufficient. 
First, intake interviews and clinical records often include a great 
deal of information which is of little use to researchers later on, 
while excluding important research variables needed for later 
analysis of treatment impact. Second, intake data are often gathered 
by different persons and under conditions quite different from those 
prevailing later when a research staff gathers the "after" measure 
ment data. In consequence, routine clinical records do not often 
include the data needed for a before-after analysis. Therefore,, 
any program which is contemplating a follow-up study with a 
before-after design using comparison groups should consider the 
problems of research data gathering well in advance of the study. 
Indeed, such planning should ideally begin before the first patient 
who will bo included in the study even applies for treatment. 

Take away the control and comparison groups from the two designs 
discussed previously and you are left with what is called a panel 
design. In this design, a group of subjects is studied before and 
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after exposure to an experimental condition, and assessments of 
e55)erimental impact are limited to these before-after measure- 
ments. An example of a panel study in a treatment program would 
be the relative prevalence among clients, prior to and following 
treatment, of illegal drug use or arrests. 

The major disadvantage of the panel design stems from the fact 
that people tend to change with time even when there has been no 
treatment intervention. Without a control or comparison group it 
is "never clear that changes observed in an experimental group 
were^the result of the experimental condition; they might have 
occurred anyway. This problem of interpreting the.results of a 
panel study has been discussed in a number of studies. It is par- 
ticularly well illustrated by the investigations of Walter Miller in 
Boston (Miller, 1959, 1962). 

Miller^s research explored the question whether detached gang 
workers could reduce the amount of delinquent conduct among boys 
in delinquent gangs. The early results of the study indicated that 
they could; the rate of delinquency among gang members went down 
following the assignment of a worker to the gang. However, this 
Observation was made without benefit of a comparison group. 
When comparison groups were added to the study design, namely, 
gangs from the same community without workers, it was found that 
rates of delinquency declined for these f roups as well. What the 
study had originally found, then, was mistakenly attributed to the 
presence of a worker. Evidently the true cksality was that de- 
linquent boys in general tend to abandon their delinquent involve- 
ment as they grow older. Since the criminal involvement of drug 
users may also decline simply as a function of maturation, com- 
parison groups become very important in drug treatment follow-up 
studies. 

For the same reason— absence of comparison groups— the panel 
design is not a good design for assessing the overall effectiveness 
of a treatment program. Nevertheless, it is a useful design for 
some kinds-of studies. In particular, it is a convenient design for 
studying variations in individual client responses to treatment. 
For example, clients who have done well can be compared with 
those who have done poorly to see if there are discernible baseline 
differences between the two groiq)?. If such differences are found, 
treatment programs can then specify the populations for which 
particular treatments are most successful. 

When a program finds for one reason or another that it cannot 
gather pre-treatment data for a follow-up study, it will have to 
choose an after-only study design. There are two main kinds of 
after-only design: one with comparison groiqjs, and one without. 
Follow-up studies employing an after-only design Without compar- 
ison groups are numerous. Two such studies are discussed here. 
However, the problems of interpreting the results of after-only 
studies without comparison groins are very severe. It is therefore 
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useful to discuss this particular design in conjunction with the 
after-only design which uses comparison groiq)s— as illustrated in 
the third study discussed here. 

The Vaillant studies. Of the studies employing an after-only 
design without comparison groiq)S, the studies by Vaillant 
(1966, 1973) are as well known as any. These reported the 
progress of a group of clients who had been treated at the 
National Public Health Service Hospital at Lexington, _ 
Kentucky. The, k-jy to.the.design.of these-and-simUar studies 
is the follow-up, some time after discharge, of a particular 
group of clients who. have received treatment for drug abuse. 
After leaving treatment, the groups of clients studied re- 
tumedJn large proportions to drug use arid. other forms of 
crime, or in other ways exhibited undesirable behavior or 
social adaptation, such as by alcoholism and unemployment. 
The conclusion most often drawn was that the treatment ex- 
perience had not had a significant, lasting, positive effect on 
these populations of drug abusers. 

The point to be kept in mind is that this conclusion could have been 
wrong. It is altogether possible that these former clients might 
have done even worse if they had not received treatment. Without 
a comparison group, this possibility cannot confidently be eliminated. 

This example points up the fact that the absence of a comparison 
group is the major deficiency of many after-only studtes. This 
opens the door to mis interpretations of the data,' as "illustrated by 
the findings of two recent follow-up studies of clients who had com- 
pleted methadone maintenance treatment (Rlordan, Mezritz, 
Slobetz, & Kleber, 1976; Gould, Forrest, & Kleber, 1975). The 
study by Eiordan et al. also used an after-only design without a 
comparison group. However, the Gould et al. study used an after- 
only design with comparison groups. 

The Riordan et al study. This study included follow-up data 
on 38 individuals who had successfully completed detoxifica- 
tion from methadone maintenance in good standing. It re- 
ported the following results: 68 per cent had remained drug 
free, 82 per cent were employed, 21 per cent were on proba- 
tion or parole, and 26 per cent had been arrested. These 
are very encouragtog results; they contrast markedly with 
the results of earlier follow-up studies. 

However, as with the Vaillant studies, the question arises whether 
it can safely be concluded that these findings were the results of 
treatment. To a large extent, it cannot. This does not become 
obvious until the follow-up results of those who completed treatment 
are compared with the results of other groups of clients who did 
not receive treatment or did not finish It. 
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The Gould, Forrest, Kieber study. Table 1 presents 
follow-up data from the second study on 30 clients who had 
oomplete^ methadone treatment. These same 30 clients 
were included among the 38 in the former study by Riordan 
et al. But Table 1 presents additional data on 93, clients 
comprising three comparison-groups r (!)■ clients left 
the program before completing treatment; (2) clients still 
in treatment; and (3) pec5>le who J5)plied for treatment but 
never entered it. (All of those in this latter comparison 
groiq? were eligible for methadone maintenance in terms of 
•age, type of drug-use, and years of prior-drug use. ) 

The data in Table 1 show that those who completed methadone 
treatment fared better, by and large, than those in the comparisoA 
groins. However, the differenceScbetween the treatment, and com- 
parison groiqps are surprisingly small and in some cases not 
statistically significant. What is particularly interesting is how 
well those .\wiio never received treatinent or &ose who left treatment 
early were doing. They were doing far better than anyone had ex- 
pected ffiid better than could have been predicted from the results 
of previous follow-up studies of clients who had received treatment 
(Vailiant, 1966, 1973), or of clients' who had left methiadone treat- 
ment against medical advice (Perkins & Blpoh, 1971). 

In fact, the comparison of these other groups with thosie who 
finished treatment leads to the conclusion that treatment alone ex- 
plains only part of the somewhat more favorable condition of those 
methadone clients who completed treatment. This conclusion is 
even more compelling in light of some other factors not disclosed 
in Table 1: namely, that many of those who completed treatment 
were employed by drug treatment programs, accomitlng for their 
employment advantage, while evidently many of those who left treat- 
ment early, or never entered it, did so because they went to jail. 
Overall, then, it is possible to conclude that methadone treatment 
probably had some positive effects in this case, but that these 
effects were modest. 

The after-only design without comparison groups, then, is not a 
good design for program follow-up because the results of studies 
based on this dep*«m are ambiguous. With comparison groups ^ the 
after-only desigt. 3lds results which are somewhat less ambiguous. 
However, as with the before-after design using comparison groups, 
there is still considerable room for misinterpretation. This is 
particularly true if tiiere were major differences between the ex- 
perimental and comparison groups even before treatment. 

Nevertheless, after-only studies do have one very important 
advantage over other designs: they can be done after the fact. 
This advantage will be especially important for programs which 
have operated for some time without planning for some kind of 
beforf>-after study. The after-only design will offer programs a 
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TABLE 1 



A Comparison, at Time of Follow-up, 
Of Three Oroiqjs of Mettiadone Treatment Patients 
And One Group Which Received No Treatment 
(Adapted from: Gould, Forrest & Kleberg 19*75) 





Methadone Patients 




Non-Patients 


Characteristic 


Completed 
treatment 


Left treat- 
ment earlv 


StUlin 
treafanent 


Never 

entered 

treatment. 


Employed 


77% 


41% 


52% 


54% 


Ihcarcearated 


0% 


22% 


0% 


26% 


Criminal cases 
pending 


3% 


22% 


4% 


11% 


Uses heroin 


0% 


16% 


20% 


23% 


Number of persons 
in the study 


30 


32 


25 


36 



Note: The percentages within each column are not mutually exclusive. 
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great deal of useful information T^^ich otherwise would have been 
lost to them, particularly if carefully selected comparison groups 
are used. After-only studies are useful tools in program follow-up, 
as long as it is remembered that the results should be considered 
cautiously. 

Case Studies Case studies are studies of a single ex-client, program, or com- 

munity. These are by far the simplest studies to design, but they 
are the loast powerful instrument for obtaining information from 
which conclusions of more general applicability may be drawn. 
Their valu^aies largely in their ability' to generate hypotheses, 
which can^be tested in more systomatic studies. Therefore, this 
technique will not receive any extended discussion here. 

SAMPLING 

A case study is a sample of one. By contrast, a study which 
.gathers data on every unit of analysis about which generalizations 
^^e to be made is called a complete enumeration^ For example, a 
study of the latter type might gather data on all clients who have 
applied to a particular clinic for treatment. The listing of total 
client populations discussed in Chapter 2 would provide the basis 
for a complete enumeration study. In between tiiese two extremes 
fall those studies which include more than one case but less than 
all cases. Care needs to be given in such studies not only to study 
design, but to sampling design as well. 

The weaknesses of case studies have already been mentioned. On 
the other hand, studying ^'everyone" is not always the best alterna- 
tive. If a prograin has many clients, studying every- one of 4hem 
might be very expensive indeed. .E3q)ending,the resources neces- 
sary to locate and interview large numbers of persons diminishes 
the resources which could otherwise be devoted to a more careful 
and detailed study of fewer persons and to securing interviews 
from a higher proportion of those selected. 

There is no virtue per se in studies with large numbers of subjects. 
What is important is that there be sufficient niunbers of subjects 
to make statistical generalizations, with acceptable margins of 
sampling error. In some simple cases this may take no more than 
a hundred subjects. In more corz^^licated situations, proper 
sampling procedures will call for larger sample sizes. 

The purpose of sampling is economj^ By using a sample, re- 
searchers are able to develop information about a large population 
while only gathering data on a proportion of the subjects in that 
population. To do this successfuUy, however, it is crucial that the 
sample be drawn from the larger population at random. In a truly 
random sample, every member of the .larger population has an equal 
probability of being included in the £iiimple. Samples drawn for con- 
venience only are not random samples in the mathematical sense and 
thus cannot be used to make statistical generalizations about an 
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entire population* For example, if the sample Includes only those 
clients who are easy to locate or willing to give an interview, there 
is a good chance that their outcomes will not be the same as the 
outcomes of the whole population of clients. Systematic samples, 
consisting for example of every seventh name in the agency flies, 
should also be avoided becmise they are not random. Since true 
random sMaples are not difficult to get, researchers should^not 
be satisfied with jess. 

Random Number To assist researchers in sample selection, random number tables 
"Tables are available, and their use is recommended. Such a table would 

be similar in appearance to the following example: i 



(Columns) 



(Rows) 


1 


-4 


5 


- 8 


9 - 


12 


13 


-16 


17 


-20 


21- 


24 


25 


-28 


1 


13 


79 


71 


62 


07 


80 


30 


01 


80 


79 


31 


50 


43 


80 


2 


95 


61 


78 


24 


39 


95 


27 


38 


10 


95 


84 


57 


51 


32 


3 


47 


53 


23 


05 


30 


61 


08 


87 


45 


50 


94 


70 


94 


73 



Almost any social science statistics text book will include such 
tables of random numbers, as welt as the details necessary for 
drawing a random sample from a population. (See Appendix B for 
a convenient example of a random number table,) The method 
described here for drawing a random sample is not the only such 
method, but it is theoretically correct and is generally accepted 
by most e:q)erienced researchers. 



How do researchers use a table of random numbers in drawing a 
sample? Chapter 2 of this manual discussed the advisability of 
making a list of every Individual within*the-populations-to-be studied. 
Such a list might be in alphabetical order, but this is not essential. 
Each individual on the list should be assigned a number in series, 
commencing 001, 002, 003, and so on, using enough zeros so that 
all numbers on the list have the same number of digits. Assume 
for the sake of example that the total list of the e:q)erimental and 
comparison group population contains 624-names, and that you wish 
to draw a sample of 200 names foom this list. 

Using the Table To use a number table to draw such samples you would be working. 

with three digit numbers on the number table, since the numbers on* 
your lists involve a maximum of three digits. You would start oh 
the number table at the beginning (or even better at a point chosen 
at random). The numbers on the table are usually read like a book, 
left to right from row to row, but they may also be read from top 
to bottom or from right to left. 

In the table used as an example above, the first group of three ran- 
dom numbers is 137 (row 1, columns 1-3), The person on the list 
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assigned that number would be taken from the population list and 
entered on the sample list. The next group of three random num- 
bers is 971 (row 1, colunms 4-6). No number on the population 
list has this number, so it should be discarded. (Numbers can 
also be discarded if duplicates hs^pen to come up.) The next group 
of three random numbers is 620 (row 1, columns 7-9). The persbn 
on the list with that number would also be entered on the sample 
list.. Following this same basic procedure, the table is then used 
until the desired 200 names for each sample have been obtained. 

This brief and simplified explanation of how to use such tables to 
draw a sample has been adapted from two standard textbooks on 
^statistics (Arkin & Cplton, 1963; Guilford, 1965). You may find it 
useful to consult such textbooks for further help in drawing a sam-^* 
pie* For a more detailed discussion of sampling design, consult 
Sudman (1976). 

As noted earlier, if an experimental study design is employed, then 
subjects will be randomly assigned to e^qperimental and control 
groups from a master list of clients. If the study involves one of 
the other designs discussed previously, then a random number 
table will be consulted to determine which persons from the treat-- 
ment and comparison group populations will be chosen for inter- 
viewing and other data gathering efforts.^ 

There are also different kinds of randoni samples. The most 
straightforward, described above, is called a simple random sam*- 
pie. You would begin with the master list of a population— for 
example; a list of all persons who had applied for treatment to a 
program during a specified period of time. From this list, a 
sample of the desired number of subjects would be chosen by use 
of a random number table. Once the sample is drawn, the subjects 
within the sample are then classified tiito subsamples. For ex- 
ample, all those subjects within the sample who had completed 
treatment would constitute the subsample designated as the e:?q)er- 
imental group. Other subsamples might consist of those subjects 
within the sample who did not enter treatment, who left treatment 
early, and who were still in treatment. These three subsamples 
would constitute comparison groups. 

A simple random sample is the easiest to obtain and the most con- 
venient for later statistical analysis. However, it will not always 
be the most economical procedure where the number of clients who 
completed treatment is markedly greater or smaller than the num- 
ber of subjects within the various comparison groups. 

For this reason, among others, statisticians have developed another 
kind of random sample called the stratified random sample. 

In using this procedure the study population is stratified into 
homogeneous subpopulations, for example into treatment and com- 
parison populations, before the samples are drawn. Sampling 
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from predefined subpopulations gives the researcher better control 
over the proportion of the respondents which will come from the 
various subgroiqps of interest. 

For example, the researcher may choose to draw samples of equal 
size froin each experimental and comparison group population, 
regardless of what proportion of the total client population is ac- 
tually in each group. (It mayj)e that^having equal sized groups 
would be optimal for analysis.) What is given up by this procedui^e 
is the ability to combine the subsamples in a simple maimer for aA 
overall tstatistical analysis of the total-population. However^ cor- 
rective rewei^ting may not be too difficult. 

Sample Size and if the number of clients from your program eligible for inclusion 
Confidence in the study is relatively small, then you will probably want to in- 

Limlts* elude them all in your follow-up. If the number is large, say more 

than 200, resource constraints may require that you liiait the studjy 

sample to a subset of the eligible clients. 

Determining the jq)propriate number to sample can be a somewhat 
complicated procedure. A rough rule of thmnb is that you should 
try to have a minimum of thirty actual respondents in each group 
which will be compared to other groups. However, there is nothing 
magical about that number. The following; discussion shows how a 
larger number will help to improve the certainty of your conclu- 
sions. 

You can knov/ ahead of time just how certain you will be about any 
statement you can make for a group of a particular size by looking 
up in a table the confidence limits, of any proportion or per cent. 
For instance, if you have a random sample of 40 clients who were 
in a job-training program, and 80 per cent of them have a job at 
follow-up, you can state with almost complete certainty that among 
all those who had job-training, at least 64 per cent had jobs, and 
not more than 91 per cent had jobs. (Statistical tables giving the 
95 per cent level of coni 'ence were used for these computations). 
If that is as accurate as you need to be, the sample is big enough. 
On the other hand, if you feel your estimate must not be off by 
more than 5 per cent (1. e. , the true values must be between 75 
per cent and 85 per cent) you will need a sample of 300, instead of 
40. 

The total sample size needed is often determined not by how ac- 
curate a single estimate must be, but by how small a difference 
between percentages in two parts of the sample you want to be able 
to show as statistically significant (1. e, that you want to be sure 
did not occur by chance). 

Suppose you are comparing drug recidivism in a treatment group 
which received group therapy to the recidivism rate in a treatment 
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groiq) which had not received that therapy, Perhapa you e^ect to 
find that 70 per cent of the |proup-therapy clients stayed off drugs 
for a year, while only 40 per cent of the comparison grotp had 
done so. You then will want to know how you can be sure that the 
group-therapy group did no\ just happen to come out better duA to h 
random sampling variationi when really there would be no differ* 
ences in success between the two grot5)s if you were able to include 
all potential clients in your sample. In other words, you want to 
know what the chance is of getting an observed difference as large 
as you did because by chance your sample happ^^ned to be unrepro'* 
sentative, when in fact there may re ally be no difference. 

The larger the samples on which the comparison is basDd, the less 
the chance that the results occurred because of chance or ''sampltpg 
error* " In fact, you can determine from Appendix C exactly how 
big a sample would be required for you to be 95 per cent certain 
that a difference that big did not occur by chance, but reflects the 
fact that group therapy is at least somewhat more successM 
(though not necessarily 30 per cent more successful)*. The tablo 
showfi the sample sizes needed, assuming equal-sized groips, fori 
you to be able to say that the observed d^erence in the proportions 
had no more than a five per cent chance of occurring due to sa2i^)l^ng 
error. In thif case, the table indicates that to draw such a con- 
clusion, you would need 45 cases each In the treatment group and 
comparison group (this number has been circled in Appendix C). 
To put it into statistical terminology, you would need 45 cases In 
eaclx sample group to say that there is "a significant diffei^nce be* 
tween the two groups at the 95 per cent confidence level. " 

The table in Appendix C makes clear that very large samples are 
required to show statistical significance when differences are 
small. But if samples are huge, even a one per cent difference 
would Ue statistically significant, even if it would be of little Interest 
practically. 

If you are more concerned about determining the size of the dif- 
ference between two rates, rather than simply knowing whether 
there is a difference, that is also possible to estimate. Appendix 
D describes tl^e procedures to be followed in determining the 
sample sizes needed to make such determinations. 

It should be emphasized that the confidence estimates discussed 
here concern generalizations you could make regarding all potential 
clients. Thus you are treating the ones studied (even if they con- 
stituted all of your clients for the last X years) as if they were a 
random sample of all potential clients. If you simply want to 
extrapolate to the clients who actually were in your program and 
finished at the same time jas your follow-up sample, then you have 
greater certainty in the accuracy of your estimates since your 
sample probably includes a sizable proportion—perhaps all— of the 
matriculated clients. At the far extreme, if all matriculated clients 
constitute the obtained sample, there is no sampling error in 




generalizing only to matriculated clients. In other words, the ob- 
siBrved results are 100 per cent accurate from a sampling point of 
view and no confidence intervals need be calculated. 

You should remember that the tables which give you sair^le sisses 
assume jroii have outcome information on eveiy case in those 
samples. In choosing the size of sample for your follow-up study, 
you will need to allow for loss of cases-by deaths refusal, and in- 
ability to Ipcate. It (s suggested you should work for at least an 
80-perxent-recovery r^; Thereforerthe^size-'of your^inl^^ 
san^le for each group will need to be one-fcxirJh again as large as 
the numbers in the table in Appendix C. 

Obviously, the number of needed sample cases is an appro^matio^ 
based on your estimates of how many respondents you can aictually 
find, and on how big a difference there is llkel3r to b^ between yooi 
two groi?)S in their 'Success" rates. However, Appendix G^will 
help you see that if you have small samples,; it will take a really 
big difference to show tq? as statistically signfficanti 

COMPLETION RATES 

Almost no study is successful in gathering data on every subject 
included in flie sample. In cpntrplled experiments some subjects 
will drop out of the experimental or cohtrdl groins before the ex- 
periment is finished. In other kinds of studies some subjects will 
not be.fcMind and others will refuse to be interviewed* The com- 
pletion rate of a study refers to the proportion of the subjects in 
the original sample for which data are available, when the stu^y is 
convicted. 

The lower the completion rate, the more the study will suffer, be-» 
cause those subjects who have been lost from the analysis are 
likely to be different from those included. This is a particularly 
serious problem in follow-up studies df druglibuseiS^ Former 
clients who refuse to be interviewed or who are unavailable for 
interview may also be more likely to have returned to drug use or 
to have gotten into trouble with law enforcement agencies. 

There is no rule which states how high a completion rate should be; 
before the results of a study can be considered valid. The closer 
the rate is to 100, of course, the more confidence the research 
public will have in its results. For follow-up studies a figure of 
80 per cent is prdjably a reasonable target for planning purposes, 
and this projected completion rate should be part of the study de- 
sign. In other words, samples shcaild be drawn with the e^ectation 
that data will be available for only that percentage of the sample. 
If data from more than that percentage are in fact available for 
analysis when the study is completed, that will be a happy plus. If 
data from less than that percentage are available (certainly if less 
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than 80 per cent are available), then serious consideration should 
be given to extending the data gathering effort so that the response 
rate can be increased before data analysis begins. 



Those interested in a more complete discussion of research de- 
sign mi^t like to consult the following: Gpode and Hatt (1952, 
chaps. 7 & 8), Selltiz, Jahoda, Deutsch, and Cook (I960, chaps, 
3 &4), Cambell and Stanley (1963^, or Kaplan (1964, chaps. 
15-19). 
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Suggested This chapter discusses the factors or variables which you may 

Measurement want to measure, and suggests ways of measuring them. As you 

read through the discussion of the many variables which might be 
included in your interviews, you will want to refer back to 
Appendix E for specific questions which have been developed to 
measure each variable. While other questions might be developed 
to get at the same informt^tion, the suggested items will provide 
an excellent starting place in most instances. 
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Of course, what you want to measure—the content of the Interview-*- 
will be largely determined by the purpose of the follow-up. As 
discussed earlier in this manual, most follow-up studies will 
normally want to make certain comparisons of interest among 
different groixps of clients. For example, in order to determine 
the relative success or failure of various treatments, you may 
want to compare current dirug use, employment patterns, aiad 
criminal behavior for groups which experienced different types of 
treatment. In such comparisons the independent variable is the 
type of treatment, and the dependent variable Is the current 
behavior as determined in the follow-up Interview. Independent 
variables are simply ways of grouping the client population into 
meaningful categories so that the effects of treatment on the 
various client groups can re? \y be measured. Dependent vari- 
ables are the measures of beh^/ior such, as current dnig use, 
which may differ among the independent variable groups. 

If differences in current behavior are fovmd among the various 
treatment groups in the follow-up study, then the question 
Immediately arises whether the differences are due to the differ- 
ent treatments, or whether they are simply a continuation of 
differences which existed prior to the treatment. If the necessary 
data Ime been gathered, you will want to compare the current 
behavior for each group with tho behavior for each group in the 
time period prior to treatment. These pretreatment measures are 
generally termed baseline data . In addition, you may want to collect 
data during treatment. This would allow an assessment of the 
effects of treatment while the client is attending the clinic, as well 
as after he leaves it. 

Whenever you compare behavior durTng two time periods, it is 
clear that the means of describing the behavior at both times 
should be as nearly identical as possible. It should be apparent 
that the data available for the first period (the baseline data) will 
set limitations on the content and form of the interview used to 
describe the second period (follow-up data). It may prove useful 
to explore these limitations in some detail. 



BASELINE DATA 

It is possible to draw a distinction betweeri-planne4 and unplanned 
baseline data. When researchers refer to planned baseline data, 
they mean that the data collection at entry into treatment is 
collected with the intent of carrying out a later follow-up. A very 
important advantage of such a prospective study is the opportimity 
to collect information which will aid in locating the client later for 
a follow-up interview. Since it is usually not known when the last 
clinic visit of a given client may be, this information should be 
obtained at the first visit to the clinic. Some important data to 
collect (for which sample questions have not been provided in 
Appendix E) are as follows: 

e name 

• aliases 
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• date of birth 

• phone number 

• mother's maiden name 

• father's name 

• names, addresses, and phone numbers for spouse, 
siblings, friends, andrelatives—especiallytihose likely 
always, to ,kno3V the client's, whereabouts 

• driver's license number 

• social security number 

• other numbers such as military service,. Veteran's 
Administration, alien registration, or state criminal 
number 



It is frequently the case that follow-up results are wanted quickly,^ 
without waiting for clients to enter treatment, complete.it, find 
spend some time in the community thereafter. Therefore subjects* 
are chosen whose baseline data were collected. some time ^6, 
before anyone had a follow-up study in mind. For federally fiinded, 
programs, the available baseline measxxres are sometinaes limited, 
to the items contaiund In the CODAP collection forms, (CODAP 
refers to Client Orieiited Data Acquisition Process. This is the 
federally sponsored system which collects standardized informa- 
tion on clients as they enter and leave drug treatment programs 
funded by the National Institute on Drug Abu.se. and .other federal 
agencies throughout the country,) \ 

The difficulty of locating clients who have, not presented sufficient 
information at admission Is an obvious problem. However, once 
the client Is located, the necessary baseline data may be obtained 
by retrospective self-report at the time of the follow-up Interview, 
While there maybe errors of recall, this Is one way to supplement 
a very limited set of baseline data obtained at the time of admis- 
sion. 



Fixed Versus Many follow-up studies collect data on the dependent variables for 

Variable Data a baseline period of one or two months prior to treatment entry 

Reporting and for a similar period Inimedlately preceding, the, follow -up 

Periods interview. An alternate approach Is to collect these.data con- 

tinuously for as long.a period as deslred~for example, from the 
period of first narcotic use to the time of the Interview, This 
method encompasses nger time Intervals and often breaks them 
down Into discrete pe jds which have particular meaning in a 
person's life, such as viie time when a respondent was in jail, in 
treatment, addicted, or employed. This continuous recording Is 
considerably more difficult than Is comparing two discrete data 
collection periods of ^qual length. However, It provides several 
advantages over the simpler procedure of taking a fixed recent 
Interval, such as the previous two months. First, bvasellne data 
collected just prior to treatment admission may be misleading. 
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Generally, the Individual asked for treatment because he was using 
drugs more heavily and experiencing more legal or other difficulty 
than usual for him. Second, limiting the follow-up data period to 
the tinie just prior to the interview tends to produce less candid 
responses to sensitive areas. Respondents are typically more 
willing to admit past as opposed to current criminal activity and 
other socially disap proved behavior . ^,Finally,^^brief baseline and 
follow-up data periods may not adequately sample relatively rare 
events such as overdoses or arrests Md cgnytctlons. 

Nevertheless, there are some important disadvantages to using 
variable time periods over which behaviors are reported. For the 
purposes of most readers xising this manual, these disadvantages 
probably outweigh the advantages. For one thing, the question 
sequences are more difficult for the interviewers to administer 
and more burdensome for the respondent to answer. They can 
also take a great^deal more interview time. In addition, proper 
analysis of the results from such questions requires more sophis- 
tication than is tiiie for fixed-interval questions. Finally, for the 
purpose of comparing groups, rather than studying individual 
histories in. depth, fixed interval questions provide reasonably 
adequate data. Therefore, in th'^ sample questions which will be 
provided concerning behaviors like drug use, criminality, and 
employment, fixed intervals are suggested. 

However, if you elect to collect follow-up data over a long period 
of time, as opposed to the one or two months preceding the inter- 
view, the following suggestions may be of help. First you will 
need to define how the continuous period is to be divided into inter- 
vals. For Instance, you might wish to divide the client Vs history 
into the periods when he was (1) incarcerated, (2) in treatment and 
(3) not in treatment. This would usually define a number of 
specific time periods for which you would collect data on a limited 
number of variables such as drug use, employment and criminal 
activity. 

Obviously^ a special set of questions will need to be asked in order 
to determine the sequence of such important events in the client* s 
life. Then, you can describe the period in terms that are mean- 
ingful to the respondent. For example: "Now I want to talk about 
the six -month period between the time you were discharged from 
the South Bay methadone program in June, 1972 and when you.went 
to jail in December, 1972. You were 23 at that time. What was 
your narcotic use during this period ? Did you work any, etc? 
The interviewer should begin at the desired time in the resplpnderit^s 
l^story, and proceed consecutively with each interval to the tiine^of 
Hh^ interview. Experience shov;s that better results are obtained if 
a:ir the questions about a given interval of time are asked at once. 
If possible, the interviewer should avoid taking the respondent 
separately through drug use history, then employment history and 
so forth. 
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irJTERVIEW DESIGN AND CONTENT 



Fo** the purposes of this discussion, it will be assumed that the 
fol'.ow-up dataware to be collected via personal interviews rather 
thm by mail or telephone. The potential number of dependent 
variables is fairly limited and will tend to be similar from one 
follow-up study to the next. On the other kund, there are many 
independent variables and the choice of which to include will 
depend on the purpose of the follow-up. It is important to define 
the^purpose quite.clearly by listing^the major questions. you.want 
your report to answer. The questions must be quite specific. It 
is not sufficient to ask: '*Is the treatment program effective?" 
Rather, you should ask: "Do participants who complete the pro- 
gram use opiates less frequently after the program than dropouts?" 

You should examine each potential interview item for its contribu- 
tion to these goals. It is tempting to include a wide range of items 
without a clear expectation of how they will relate to the purpose, 
but this invariably leads to imsatisfactory results. The amount of 
time the respondent is available for interview, and the cost and 
time available for the data collection and analysis, are limited. 
Therefore, you should focus on the primary questions to be 
answered before Including less crucial Items. You can often 
Improve the quality of the results by examining a crucial question 
such as drug use from more than one perspective, or for a longer 
period of time. This approach Is generally preferable to a more 
superficial coverage of a wide area. 



Initially, In selecting questions to measure the dependent variables. 
It Is desirable to emphasize those Items which provide objective 
descriptions of behavior— preferably In quantitative terms for 
which well verified and standard measures exist. The reason for 
this emphasis Is not that less quantifiable variables are unimpor- 
tant, but rather that the methods for assessing them tend to be less 
precise and sometimes less reliable. 

Second, It Is preferable In general to design your .'"^terview with 
relatively neutral and nonthreatenlng questions at the beginning. 
This will permit time for the interviewer to establish rapport 
before asking Items of a more sensitive nature. But these 
beginning questions should*not be totally uninteresting, because 
you do not want to bore your respondent. One possible Introductory 
question Is: "How are things going for you these days—would you 
say very well, pretty well, or not too well? " 

A third principle of Interview design Is as follows. V/hen a question 
Is asked which requires a choice among four or more alternatives, 
the use of a card listing the alternatives Is generally recommended. 
This "show-card" can be handed to the respondent, who can then 
read the alternatives. (See Appendix E for examples.) 



Some Guidinj 
Principles 



Here are some principles to keep in mind in designing your 
interview. 
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Fourth, for continuous variables such a*^ age or amount of incomei 
the interviewer should record the response as a specific number 
rather than as fallitjg within an interval. This will enable the 
calculation of the mean, median, and other statistics from the 
original as opposed to the grouped data. 

A fifth principle is that response alternatives should sometimes 
include a "Don't Krow" category. However, the number of times 
this category is used should be minimized by careful consideration 
-of-the^various-available specific responses, ^ 

Ftoally, keep your questions as simple as possible. At first 
glance, size of family is a simple concept. You might want to 
ask: how many brothers and sisters do you have? But ieven this 
apparently simple question is difficult. What about step-brothers 
or - sisters? What about foster children who lived in the 
respondent's home? Should the respondent count siblings or 
step -siblings who never lived in the same housie with the respond- 
ent? Do you want him to coimt or not to count siblings who died? 
The point is not that you must allow for every possible contingency 
In your questions; this would complicate life too much for most of 
your respondents. But you should be. aware that even questions 
that appear straightforward may get very condpllcated. 

MAJOR VARIABLES-TOJJONSIDER 

The following three sub-sections list some of the more common 
variables appearing in drug treatment follow-up studies. Appendix 
E gives examples of questions used to measure each variable. In 
many cases, a variable will have been measured In the baseline 
data collection, and will not need to be re-measured. Such vari- 
ables are marked with an asterisk in Appendix E, 

While the items are listed under the three categories—independent, 
dependent, and other variables — it should be emphasized that this 
grouping is by no means absolute. A given variable is generally 
an independent variable when it occurred prior to entering treat- 
ment (type of treatment is an exception), and Is generally a 
dependent variable when it occurs between entering treatment and 
follow-up. For instance, employment is ah independent variable 
If you ask how Individuals who had ever held the same job for two 
or more years before treatment differ in posttreatment dru(( use 
from those who have not held a job that long. But employment is a 
dependent variable if you ask whether persons who complete treat- 
meiu are more often employed at follow-up than those who dropped 
out. 
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INDEPENDENT VARIABLES 

1. Demographic data , 

^ date of birth 
sex 

• ethnic background 

• place of birth 

• education before treatment 

• highest grade completed 

• highest degree 

o age leaving school 

2. Family background , 

• parents* education 

• parents* occupation* 

• religious backgroimd 

• broken home before 12 

• parents* history of alcoholism 

• parents* history of arrest 

• parents* history of opiate use 

• number of younger siblings 

• number of older siblings 

• siblings* history of alcoholism 
o siblings* history of arrest 

• Gibllngs* history of opiate use 

3. Military experience before treatment , 

• length of service 

• whether served in Vietnam 



In the sample interview, father's (and mother's) occupation is 
recorded verbatim, then immediately coded by the interviewer. 
This coded value provides a kind of status ranking, from **1**, a 
high status job, to **7**, a low status job. (Codes 8 and 9 do not 
indicate luiy particular status ranking. ) For analysis purposes, 
this coded value is very useful and because the interviewer codes 
the occupation immediately, any ambiguity orjuncertainty as to the 
proper code may be resolved by getting more information. 



4. Treatment received at this agency . 



• date of admission this time 

• date of discharge (if not still in program) 

• continuity of treatment 

• length of time in treatment 

• number of entries into treatment before this admission 

• medications received 

• other services received 

• reason for termination of treatment 

One reason for asking these questions is to determine whether 
there are important differences In outcomes for different groups. 
For example, it may be the case that high school dropouts are 
benefiting most from program participation. Another reason: for 
asking these questions is to allow selection of subgroi5)s com- 
parable to thosi in other programs. For example, a methadone 
maintenance program in New York may report that a certain 
proportion of their yoxmger black clients are drug free at two 
years, and you would like to know whether similar young people 
In yoiur program do as well. Still another reason is to allow com- 
parison of the respondents in the foUowrup study with those who 
could not be located for the follow-up interview. This comparison 
may help determine whether there are certain lypes of clients 
systematically excluded from the follow-up. 

It is by no means necessarjr or advisable that all these independent 
variables be measured in every follow-up "study. Care should be 
taken not to become overly ambitious. You should restrict your 
study to those questions that can be of value-to you. Some variables 
you will definitely want because of their likely relationship with 
certain outcomes. Age and sex, for example, are related to 
employment and criminal behavior, so you will want to include 
them. 

It should also be pointed out that many of^these independent vari- 
ables will not change between the baseline and follow-up data 
collections. They therefore can be ascertained equally well at 
baseline or at follow-up. However, the respondents* motivation to 
respond accurately maybe very different when interviewed by 
program staff as they enter the program than it is later when they 
have left the program. Entry may have occurred under some 
degree of coercion, and this fact could color some of the responses. 
Thus for some questions, you may feel that it is useful to ask the 
same questions at both baseline and follow-up. 
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DEPENDENT VARIABLES 



Eiv^ployment 



Tobacco and 
Alcohol Use 



Drug Use 



Criminal 
Activity 



The following items concern employment (or other productive 
activities, such as schooling) in the eight weeks prior to the 
interview: 

• occupational history 

• number of days worked full-time 

• nimiber of days worked.part-time 

• type of work 

• date started 

• nimiber of different employers 

• amoimt of take-home pay 

• major sources of support 

• any schooling or training 

Tobacco use may be readily measured In terms of the number of 
packs or fractions of packs of cigarettes smoked per day. Meas- 
uring alcohol is somewhat difficult because it is consumed In 
different forms, and the dimensions of abuse Include both average 
consumption per unit of time, and tha frequency of 'pronounced' ' 
intoxication. Additional items which might be covered are: 

• hospitalizatlon/treatment for drinking problem * 

• arrest while drinking 

• family/job problems after drinking 

There are several ways of assessing drug use, depending on the 
needs of the study. If you simply wish to compare usage at the 
time of the interview with that for a prior baseline period, it may 
be sufficient to record whether the respondent has used each type 
drug within the previous eight weeks and the frequency of use. K, 
in addition, you wish to obtain data on whether he has ever used, 
the age at first use, age of first daily use (if any), and the year of 
last use, you can employ a grid such as that shown on the following 
page. 

For drugs used dally, it may be useful to determine the number of 
times used per day and the amount and cost of the drug consumed. 
This is especially true for heroin, since the cost Is often quite 
large and varies widely among daily users. In this connection, you 
may also wish to determine whether the cost of the respondent's 
drug use Is totally or partially supported by drug dealing. 

This Is a difficult behavior to measure adequately. Data on arrests, 
convictions, and sentences represent only a very small proportion 
of the overall criminal activity. However, for some purposes liiey 
may constitute useful information for analysis, particularly since 



ERLC 



55 



B7 



TABLE 2 



Example of Drug Use Data Table 

Now I would like you to summarize your non-medical drug use history. For each 
drug group I'm going to read to you, please tell me: (1) if you ever used it; (2) the 
age of first use; (3) age of first regular use (daily or almost daily for a month or 
more); (4) year of last use; and (5) usage during the past two months. (SHOW, CARD) 
This does not include medical use . (REPEAT EACH QUESTION FOR EACH ITEM 
■ . ASNEEDED). 



<^ (2) (3) (4) (5) 



DRUG GROUP 


EVER 
USED 
YES NO 


AGE 
AT 
FF'^>T 


AGE AT FIRST. 
REGULAR USE 
(daily for 30 
days or more) 


YEAR OF 
LAST USE 


USAGE 
DURING LAST 
2 MONTHS* 
(SHOW CARD) 


A. Glue, spray 
cans, gasoline, 
etc. _ 


1 2 










B. Marihuana or 
hashish 


1 2 










Hallucinogens 
(LSD, mescaline, 
peyote,PCP,etc.) 


1 2 










u» ^r.^i ampneta — 
mines & other 
uppers (whites, 
benzedrine, 
dexedrine,etc.) 


1 2 










Iniected m^^tham- 
phetamine (meth, 
speed, etc.) 


1 2 










F. Barbiturates and 
other downers 
(reds -Seconal, 
yellow jackets, 
doriden,quaa- 
lude, etc.) 


1 2 










G. Heroin 


1 2 










H. Metbridone or 
dolophlne (On 
the street) 


1 2 











*For last two months code: 1 not at all 

2 less than once a week 

3 1-4 days per week 

4 5-7 days per week 
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TABLE 2 (Continued) 



(1) (3) (4) (5), 



DRUG. GROUP 


EVER 
USED 
YES NO 


AGE 

AT 
FIRST 

USE 


AGE AT FIRST 
REGULAR USE 
(daily for 30 
days or more) 


YEAR OF 
LAST USE 


. USAGE 
DURING LAST 
2 MONTHS* 
(SHOW CARD) 


I . Other opiates 
(opium, morphine 
codeine, pare- 
goric, dilaudid, 
demerol, 
percodan) 


1 2 




.» 






J. Cocaine 


1 2 










K. Tranquilizers 
(Valium, 
librium, 
miltown,etc.) 


1 2 











♦For last two months code: 



1 not at all 

2 less than once a week 

3 1-4 days per week 

4 5-7 days per week 
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respondents are likely to be more truthful about crimes for wHch 
iiiey have been apprehended than about crimes for which they have 
not« If you choose to use ar7;ests» convictions, and sentences as a. 
measure of criminal activity, raure reliable results may be ^ 
obtained by recording, these events over a fairly long period of 
time. The sample questions in Appendix E refer to a time period 
of only two months. But if your particular follow-up includes only 
individuals^ who have been out of treatment for a year or more, the 
sample questions could be revised to refer to a period of a year. 
In addition 'to arrests, you should also record periods of probation^ 
parole, or other legal supervisory status as well as incarceration. 
Data on arrests and convictions will be more meaningful if 
orgaiiized by type of offense (crimes against persons, crimes 
against property, drug offenses, and so on), as done in the sample 
interview. 

Some sample questions are also provided with which you might try 
to secure self-reports of criminal behavior for which the respondents 
were not apprehended. Specifics are not requested, though they 
might be usefuHtp have, since they would be likely to increasi the 
honesty in antswering. 

The follow-up interview allows an opportunity to determine the 
client's impression of the treatment program and the program's 
impact subsequent to discharge, Tliis information can provide 
you with valuable information as to the strengths and weaknesses 
of the program from the client's perspective, as well as suggestions 
for improvement. You may want to spend a considerable proportion 
of interview time in obtaining information of this kind, since it will 
almost certainly be helpful to you. Possible items include: 

• ease of gett^g to program 

® treatment staff job performance 

« gain of understanding of drug problems 

o staff help with other problems 

o stsff concern for client as an individual 

® how much individual treatment 

© desire for more individual attention . 

® satisfaction with treatment 

o program good enough to reconamend 

• program reputation among dw^ users 

• things liked about program 

« things disliked about program 
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There may be a nuinber of other aspects of your program about 
which you would like to have your clients* impressions. If so, you 
should draft your ^own questions —perhaps following the formats 
used for the sample items listed above~and,pretest them on a- few 
respondents to see how well they work. 

OTHER VARIABLES 

1. Type of residence. 

2. Living arrangement . 

3. Marital status and adjustment . 

4. Number of times married . 

5. Number of dependents. 

6. Urine ssmyle^ (This will be discussed further under 

validatii^ measures. ) 

PRETESTING THE INTERVIEW 

It is difficult to overemphasize the importance of adequately pre- 
testing your interview. Pretests just prior to going into the field 
are essential because they can tell you how respondents will inter- 
pret the questions you ask, how smoothly the interview flows, and 
how long it takes. 

Pretesting is also a useful aid in developing the interview in the 
earlier stages. Rather than tryii^ to anticipate all the questions 
and how to ask them, it Js usually more efficient to begin with a 
rough draft, administer it to two or three persons, revise, 
administer again, and revise again, until the interview schedule 
appears to be set. In revising, you should go over each question 
with the interviewer to confirm that your intentions are being 
carried out. 

You should also be timing the various segments of the interview 
during the pretest. Include a place (and instruction) for the inter- 
viewer to record the time at various spots in the interview. Then 
you can see how long the interview is nmning, and what segrnerits 
may need to be shortened. 

A structured interview is one in which all questions are asked in a 
predetermined order, with a precise wording for each question. 
This is a highly desirable feature for an interview, since it reduces 
the possibilities for interviewer bias. Questions maybe open-ended , 
where verbatim responses are recorded, or closed-ended , where 
the respondent chooses from a set of alternatives provided to him. 
Closed-ended questions are preferable wherever possible, since 
they usually facilitate the task for both interviewer a..d respondent, 
and they are ready for data processing as soon as the interviewer 
circles a code. 
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Tto early drafts used in pretests can be relatively unstructured, 
with many open-ended questions. However, as you approach the 
final interview, you should firm up the content until you have very 
structured interview, with as many closed-ended questions as 
possible. 

If at all possible, you should have a professional survey researcher 
check j^ur final interview for clarity of questions and responses. 
A person skilled in constructing interviews can do this in a short 
time and will normally provide nimierous suggestions for improve- 
ment. 

If you plan to make use of automated data handling, you may want 
to precode the interview responses and list the data card column 
numbers directly on the questionnaire. 

In doing this, you sbould.remember that when more than one 
answer to a single question is allowed, each possible answer must 
be assigned its own colxunn, in which its presence or absence is^ 
coded. 

VALIDITY CHECKS ON IMPORTANT MEASURES 

You may want to check the accuracy of the self -report data by 
obtaining independent measures of certain Items in the int^^rview. 

For employment, the Social Security Administration will provide 
groiQjed data for research purposes, showing the percentage of a 
specified list of individuals fo^ which earnings were reported d^ 
ing a specilcred time. " Such data are not available on -iidividuals 
and you must provide the social secxirity numbers; No information 
is included on employment for which social security payments were 
not made. In addition to providing a validity check on the self- 
reported information, social security data also^provide another 
means of determining whether reported employment for the overall 
sample changes following treatment, or whether reported employ- 
ment differs for subgroups within the sample. 

If criminal records (rap sheets) are accessible for. your sample 
they can be compared with self-report data on arrests, convictions, 
sentences and legal supervisory status. (See Chapter 6. ) Some- 
times these records are incomplete, especially with regard to short 
jail sentences and periods of probation. You should not expect to 
find perfect agreement between the official record and the subject^s 
report of tfie particular charge, since the charge often is changed 
In the course of coming to trial. In the event you are employing 
continuous data collection periods, prior information on periods of 
incarceration and legal supervisory status will enable you to better 
structure the discrete intervals about which the respondent will be 
questioned. 




The use of iirinalysis to validate self -reported data on ctirrent 
drug use Is controversial. Those opposir^ this procedure Imve 
argued that it is not conducive to the establishment of good rapport 
between the interviewer and respondent; that those respondents not 
correctly reporting current drug use will not provide a urine 
specimen for the same reason; that, at best, the urinalysis only 
gives information on current use; and that the poor validity of 
urinalysis results obtained through commercial laboratories 
severely limits their usefulness for checking self-report data. 
This last point is an important one;- many people believe incor- 
rectly that laboratory analysis of urine sample provides a highly 
accurate and valid determination of what drugs have been used. In 
fact, errors are very often made. An analysis may incorrectly 
identify which drug is present, may^f ail. to detect^ the pres^ce of 
drugs, or may incorrectly report a drug to be.presjent whehit is 
not. Tbese^errors may occur because of^machlne inaccuracies, 
himian errors in testing, or improper record keeping. For these 
reasons, it is often advisable to include in the samples sent for 
laboratory analysis some samples whose drug content is known. 
While not foolproof, this meth«jd may lead to greater or less 
confidence in the laboratory reports. 

All of the above arguments against urinalysis have merit. However, 
current drug use falls In the category of sensitive responses and 
there Is good reason to expect \mder-reportlng even under optimal 
conCUlons of rapport. As mentioned earlier, with the proper 
Interview procedures and Interviewer skill, you can expect to 
obtain accurate answers within the limits of recall ability for 
those areas where the respondent has nothing to lose. Current 
Illegal behavior does not fall in this category and an tmknown 
proportion of your sample will likely deny or m in i mize their cur- 
rent activity In these areas. The strongest argument In favor of 
collecting urine specimens Is that It enables you to establish some 
confidence limits concerning the self -report data on curren*^ drug 
use. Various follow-up studies have demonstrated that it Ss feas- 
ible to obtain urine specimens from ninety per cent or more of the 
respondents Inteirvlewed. Glyen this high a response rate and 
reasonably accurate laboratory analysis, you will be able to con- 
clude that the rate of current drug use Is probably somewhere 
between the nxmiber obtained by self -report and the siim of the 
following: 

* self -reported use 

« denied use, but had positive urine 

• refused to provide specimen 

One procedure that has resulted in a high rate of cooperation with 
respect to obtaining urine specimens Is to offer an added monetary 
Inducement at the end of the Interview for this additional cooperation. 
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DEVELOPING OTHER MEASURES 



Again, the specific questions provided in Appendix E are meant to 
give you some fairly well developed alternatives from which to 
choose. There may be otb^r variables which will better meet your 
needs. Similarly it may make sense to revise sonae of the ques- 
tions provided—for example, by changing the time interval about 
which the question asks. The point is that there is nothing sacred 
aboixt these particular measures, and yoif should feel free to 
develop your own to whatever extent makes sense to you. However, 
you shoidd pretest such measures carefully before actually adopt- 
ing them in your study. 
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Federal The protection of an individual's privacy has long been considered 

Regulations an important social value. Both the federal and state governments 

have rules and regulations protecting an Individual's privacy. The 
discussion In this chapter covers a few of the more important 
federal laws and regulations in this area. 

Regulations for the "Confidentiality of Alcohol and Drug Abuse 
Patient Records" have been Issued by The Department of Health, 
Education, and Welfare (H. E. W. ). They constitute Part 2 of Title 
42 of the Code of Federal Regulations, and were originally 
published July 1, 1975, at pages 27801 through 27821 of Volume 40 
of the Federal Register. 



63 



ERJC 75 



These regulations attempt, to strike a balance between the need 
to do research in drug and alcohol problems, and the preservation 
of the privacy and anonymity of those who receive services. As 
outlined in this regulations, all treatment records are confidential 
and may not be used in any civil, crinainal, administrative, or 
legislative proceeding without the client's written consent. 
However, consent is not required for disclosure o* such records 
for the purposes of research, audit and program follow-up. 



Interpretation of these regulations depends on whether the 
program research is voluntary or compelled. For pro- 
grams which vblimtarlly participate in research projects, 
the interpretation of the regulation is left up to the researchers 
and the program. On the other hand, a program may on 
occasion be compelled to participate in research—for 
example, by a condition of funding or licensing. of a govern- 
mental agency. To cover such situations detailed jprocedures 
are set forth in the regulations. In. general,, anyone obtainr 
ing such information is prohibited from disclosing it in any 
manner that could identify the clients. These regulations, 
then, serve a double purpose: to make the work of medical 
and social service institutions more effective, while at the 
same time making treatment acceptable to individuals who 
may have hesitated to seek such services In the past for 
fear of repercussions from employers or friends. 



RISKS TO THE CLIENT 

Ethical issues arise at every stage of a follow-up study — 
when locating the ex -client, when interviewing, and when 
processing and analyzing the data. There are various ways 
in which a client or ex-client could be harmed by participating 
in a foUow-xip study unless proper precautions are taken: 
(1) if in the course of searchii^ for htm at /pllpw-up his 
status as a former drug user were revealed to employers, 
relatives, or friends who did not previously know it; (2) if 
in the course of being located for interview, his current 
whereabouts or his identity as a drug user were revealed to 
creditors, police, or others whom he does not wish to have 
this Information; (3) if infprnxation atgut illegal acts or 
discreditable behavior in his treatment record or In his 
follow-up interview should get into the hands of police, 
creditors,, relatives, or friends; (4) if criticism of the 
treatment program expressed in interview, or violations of 
Its rules while he was a client, should get back to the pro- 
gram without his consent; (5) if the interviewer should use 
the interview relationship as a means of treating the ex- 
client agttinst his wishes or without proper supervision, or 
if the Intex^lewer should exercise improper inliuence on an 
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The Risk of Relapse 



Informing the 
Patient at 
Intake 



ex-cllent to re-enter treatment or cHaQage programs; (6) if 
In writing up results, sufficient details about individuals 
were given to permit their identification. Each of these 
problem areas will be discussed in turn. 

There It one further risk that may cross your mind: will 
recalling his drug history during the follow-up interview 
reawaken the drug craving of a former client now off drugs, 
or create xmdue anxiety or distress when he recalls, his 
addiction? While reviewing the past might be unpleasant 
for some ex-clients, most appear to enjoy reminiscing, and 
to welcome the interest shown in them by being included In 
a follow-up. There has been^^no. report of relapses 
attributed-to participation in such a study. 

Although th(jre is no evidence that follow-up interviews 
actually increase the risk of relapse, it is probably prudent 
not to devote much time in the follow-up interview to a 
detailed recounting of the "highs" previously enjoyed. It is 
also important to remind the ex-client that his participation 
is voluntary, that he may refuse to answer any question, 
and that he can always discontinue the interview if he 
wishes. With these options open to him, there seems littlie 
danger that the interview will cause undue distress even to 
the occasional sensitive ex-client. 

PROTECTING THE CLIENT DURING THE SEARCH PERIOD 

Assuming that the experience of being interviewed does not 
in itself pose a serious risk, special precautions are neces- 
sary to protect the client against the rick of improper dis- 
closure of information, mentioned above. 

As suggested in Chapter 6 of this manual, the danger of 
revealing the ex-client's identity as a drug user while try- 
ing to contact him for an interview can be minimized in two 
ways: (1) arranging ahead of time with the client about 
people who can be contacted for an address and how they 
will be contacted, and (2) having the follow-up carried out 
by a group with an institutional affiliation that does not itself 
give away the fact that he was a drug client. 

If possible, the client should be told at entry into treatment 
that he may be contacted for follow-up, and asked for names 
birth dates, addresses and telephone numbers of persons 
who will always know his address. He should then be told 
precisely how the inquiry for an address will be made. For 

example: "I am Mr. from the X 

Research Group. We are trying ro reach Mr. 

because he was seen in a health program some years ago. 
We are contacting people who received services from 
various (state, county, private) clinics to see how they liave 
gotten along since. 
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letters to 
Clients 



Neutralv^uspicss* 
for the Study 



Letters to ex-cllents and their relatives should be sent in 
envelopes with letterheads corresponding to that of the 
" X Research Group, These should be equally 
noncommittal in content, because it is not at all certain 
that the ^-client will open his own mail, or if he does, 
remember to put it away after reading it. If possible, you 
should prepare the letter ahead of time and show it to the 
client at intake so that he will recognize it later -and not 
throw it in the wastepaper basket, 

These precautionS'^ainst revealing the client's identity as 
a drug user require that if the follow-up is to be done by 
members of your own program, they should identify them- 
selves in the name of their parent organization,, .such as the 
Veterws Administration, the state department of health, or 
the imlversity. Permission to use the parent organization's 
name will ideally be arranged ahead of time, so that the 
client can be told at intake. If the parent organization is 
not willing to be listed as the sponsor, other alternatives 
include sponsorship by an outside organization, creating a 
research group with aii innocuous name j or conamunicating 
under a physician's name, with an office adcUress but no 
institutional affiliation listed. 



Protecting the Client 
When Searching 
Agency Records 



Never Swap 
information 



PROTECTING THE CLIENT'S IDENTITY FROM 
CREDITORS AND THE LAW ENFORCEMENT SYSTEM 

In locating a former client It will sometimes be necessary 
to search police records, credit bureau records, or 
records of other agencies. It Is Ideal to do your own 
search, so that you do not have to turn over a list of n^tmes, 
and so that you can be sure the search is done thoroughly. 
However, if the ^ency wants to do its own searching, it is 
necessary that the list of clients submitted does not enable 
that agency to identify the persons on it as drug users. One 
way to protect the list of names is to salt it liberally with 
names of invented persons with age and sex similar to the 
client group. You can then tell the police or other cooperating 
agency the true purpose of the study, but also assure them 
that only some of the persons being sought are ex-clients. 

Some agencies you contact in seeking clues to a curreni 
address may be looking for the same person you are. They 
may offer you some old Information but In turn want you to 
tell them If you find something more recent. In such a situa- 
tion you should make it a rule never to swap: you can 
receive information, but you must never give any. This 
even pertains to persons who, so far as you can tell, mean 
no harm to the ex -client: if his own mother does not have 
his address, this may be because that Is the way he wants It. 
In mch cases you should do no more than offer to tell him 
she wants him to get In touch with her if you should find him. 
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PROTECTING THE CLIENT 
DURING THE INTERVIEW PERIOD 



Pata In In ordinary opinion surveying, it is very easy to protect the 

Agency confidentiality of the interview just by excluding identifying 

Records data from the record. This is not so easy in follow-up 

studies because in most cases you want to be able to link 



that interview to Information in the client's record In order 
to learn what kind of pretreatment history and treatment 
experience leads to success or failure. As a result, special 
procedures to assure confidentiality are advisable. 

The first step is to decide what it is out of the client's 
earlier record that you may want to relate to his outcome, 
and to transfer that information to another record which 
does not identify the client by name, social security numbed, 
birth date, address, or hospital number. To achieve this 
purpose the Information may be transferried inxoded form, 
thus getting rid of irrelevant detail such.as relatives' 
names or precise date of entry into treatnient--data that 
^ might identify him even if all other identifyii^: data were 
• renioved. The coded abstract of his pre-treatment and 
treatment information should then be. given an arbitrary 
identification number — not his hospital or clinic number^ 
The list linking his identity with that arbitrary number 
should then be physically separated from the record, and 
kept locked up. ' 

Data Obtained As soon as the follow-up information has been collected, all 

in Interview identifying data should be removed ifrom the interview and 

replaced by the client's arbitrary identification number. Hls| 
follow-up Information can then be linked to his coded treat- 
ment record by means of that arbitrary number. But if this 
procedure is followed, neither can be identified with any 
individual without the locked-up list that pairs that number 
with a name or a hospital number. 

With this system, there is not even any record that can 
breach confidentiality. Ho^/ever, coders of treatment 
records and the interviewers will still know the client by 
name. They must be reminded frequently that ho names are 
to be breathed outside the research group. This means not 
even in the hallways and elevators of the buildii^, much less 
outside. 



Obtaining Immunity While these precautions protect interview data against care- 

from Subpoena less disclosure, what about the dangers of subpoena? After 

all, if both the locked up list and the interviews were sub- 
poeaaed, individuals could be identified. Several federal 
laws provide protection against subpoena. For example, 
section 408 of Public Law 92-255 protects drug clients' 
records and drug research against unauthorized disclosure. 
Such records may only be subpoenaed by a court of competent 
jurisdiction as outlined in the regulations. 
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Requesting Immunity Further protection can be obtained under Section 872(c) of 

from the Justice Title 21 of the United States Code, which vests authority in 

Department the Attorney General to give a grant of confidentiality to any 

drug r esearch project. Section 0. 100 of Title 28 of the 
Code of Federal Regulations, as amended July 10, 1973 
under 38 F. R. 18380-82, delegates this authority to the 
Administrator of the Drug Enforcement Administration of 
the Department of Justice. This protects drug research 
records against all subpoena, while the project is active. 
To qualify for immunity, your follow-up study naust lequest 
the protection of the Department of Justice under this law 
before the study actually begins , so that there will be no 
uncovered period. 

Requesting Immunity A similar kind of immunity from subpoena can be obtained 

from HEW under Section 242a(a) of Title 42 of the United States Code, 

which ves^.s authority in the Secretary of Health, Education, 
and Welfare to give a grant of confidentiality to "persons 
engaged in research on mental health, including research 
on the use and effect of alcohol and otier psychoactive 
drugs." On December 4, 1975, proposed rules were 
published in the Federal Register in regard to the exercise 
of such authority (40 F. R. 56692), but at this writing 
(AprJl 7, 1977) such rules have not yet been adopted. 
Despite the absence of regulations governing procedure, 
the Secretary has the authority to act under the statute, and 
has done so on a number of occasions. An application for 
a grant of immunity under this statute with respect'to 
research related to drug abuse or treatment for drug abuse 
should be made through the Director of the National jtostitiite 
on Drug Abuse. Under the practice followed by HEW, such 
a grant of immunity would be in perpetuity, not in the sense 
that the project can go on forever, but that records generated 
while the project is going on continue to be protected after it 
is terminated. Also, under HEW's practice, the grant might 
be subject to certain conditions designed to prevent fraud 
and to deal with medical emergencies, but these would not 
ordinarily appear to have any relevance to research or " 
investigation which in itself contains no element of admini- 
stration of drugs or delivery of services. 



THE CLIENT'S CRITICISM 
OF THE DRUG PROGRAM 

Confidentiality One important goal of the follow-up study is learning the 

Within the Agency client's opinions about the drug program or his history of 

compliance with rules while in the program. But it is 
virtually impossible to keep these confidential without 
employing outsiders as interviewers. If this information is 
not kept confidential, there is a danger that the client's 
criticisms of the program, or his revelations of rule- 
breaking, will influence how he is welcomed back if he 
decides to return, or his future treatment if he is still in 
the program at follow-up. 
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Informing the Client In large agencies, there may be a separate research unit 

which is able to do follow-ups. and still preserve ccnfi- 
dentiality within the agency. But in small-agency, smali- 
budget studies, this will not be possible. U treatment 
personnel will be doing the interviewing, you should at 
least be sure the ex-client is aware that those who treated 
him in the past or who might treat him in the future may 
find out what he said about his treatment experience. While 
Informing the client makes asking him about his opinions 
of his treatment and about his compliance with treatment 
acceptable from z.n ethical viewpoint, it may lead him to so 
distort his answers that they are not scientifically useful. 
Therefore, If at all possible, you should try to use inter- 
viewers who are not also part of the treatment staff. 

IMPROPER INFLUENCES ON TREATMENT 

Improper Advice At the time of the foUcw-up Interview, ex-cUents may be In 

By Interviewers medical or legal difficulties. Special precautions are neces- 

sary during this Interview period to avoid forcing the ex- 
cUent Into undeslred or Impronar treatment. It Is tempting 
for a sympathetic Interviewer', particularly one having some 
treatment skills, to try to help the ex-cUent. However, the 
ex-cUent has the right to seek the form of treatment he 
prefers, or not to seek any treatment. It is important to 
recognize that advice volunteered with respect to a drug 
abuse or emotional problem — ^both of which are often handled 
by psychotherapy or legal counsel—can easily be Interpreted 
as treatment. In any case, It Is not ethical for an Interviewer 
to take a treatment or counselor role without an explicit 
request from the ex-client. If the Interviewer la so re- 
quested, he may suggest that the ex-cUent reenter the pro- 
gram formally, so that no question can arise that the treat- 
ment Is not properly supervised. 

Ethical considerations and scientific validity argue against 
offering tmrequested advice during the follow-up survey. If 
advice is requested, the Interviewer can say, 'WeUltalk 
about that right after the Interview is complete. " In this way 
any advice given (or any refusal to give advice) will not bias 
the remainder of the Interview. If the client Is In trouble 
but has not asked for advice, the interviewer should only 
volunteer: "If you should ever want help with that problem, 
you could call X agency. " 
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PROTECTING THE CLIENT 
WHEN PRESENTING RESULTS 



No program would be so thoughtless as to publish actual 
names of subjects when reporting results from a study. 
However, it is often tempting to present brief case histories 
to illustrate various kinds of outcomes. It is well ^ orth 
considering that even without names, these case histories 
can often be identilied by persons who know a few of the 
background facts. For Instance, a man accused or convicted 
of a crime may be well known locally; but it may not be 
known that he was a former drug addict. Describing his 
crime may be enough to identify him for people in his hom^v 
town and thus expose him as a drug user. 

Clearly, such vignettes describing individuals should be 
used sparingly and should be stripped of all the circum- 
stantial detail that makes them, identifiable. Unfortunately, 
this often makes them much less entertaining reading. 
While a report that sticks to statistical tables without case 
reports may be less readable, this will not affect its value 
as a guide to future planning. Moreover, such a presentar 
tlon Is much less likely to endanger the confidentiality of 
the subjects who made It possible. 

CONDITIONS UNDER WHICH 
DISCLOSURE IS ETHICAL 

The confidentiality considerations mentioned thus far 
assume that the ex-client does not want information he gave 
in the follow-up interview revealed. However, It sometime^ 
happens that the client does want some Information given 
out sometime later —usually either to his lawyer or to his 
doctor. Therefore, you should be careful even when some- 
one appears with a signed permission slip from the ex-cllent. 
The ex-client may not know exactly what information you 
have about him or how It looks when written down. 

In such cases the best procedure Is first to tixm such 
records over to the ex-cllent himself. He can then look 
over a transcript and decide whether all of It or only parts 
of it are rele *int and helpful to reveal for the Intended pur- 
pose. The lact that the client has signed a permission slip 
relieves you of the legal responsibility but not of the moral 
obligation. When he signed the slip. It probably never 
occurred to him that he would actually be able to screen 
the contents himself. 
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Wiy Drug Abusers A follow-up study of drug program clients presents all the diffi- 
Are' Hard to Loccte culties foimd in any follow-up sftidy, plus some additional prob- 
lems. In particular, unique" issuesTaxe^ the- 
S'abjects. As a rule, dmg abusers will be difficult to locate be- 
cause many are more mobile and less often in contact with their 
families than average foUowup subjects* These subjects also 
represent an extreme case for the following reasons: (1) moat 
are young males, the most mobile group even among non-deviant 
populations; (2) they are usually very poor, which further in- 
creases their mobility; for example, they may be evicted for not 
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paying the rent, or may move to dodge creditors; (3) tiiey are 
less ni'fen registered iumany of tbe sources that readily provide 
cha!iges of address for iaost people, such ?s the rosters of elec^ 
eric and gas companies, telephone books, voting records, drivers' 
licenses, or alumni records; (4) they often have poor ability to 
sustain-toterpersonal relationships, which means that their earlier 
spouses or mates may no longer know where^they are, and that 
riilatives may not have heard from them for a long time. B*urther, 
former driig abusers, may be difficult to find at home even after 
home addresses are located, because those who have relapsed: 
will be out "hustling'' and "copping., " 

These reasons for unusual difficulties in locating drug treatment 
clients foi follow-up have beien listed aa tiidigh all former drug 
clients were ftlike. Of course, they are not. Some are a great 
deal easier to locate than others. Those who have remataed in 
the treatment program longer will be easier to locate because 
flieir habits and interests will be better known and because their 
longer records will provide more vilues for locating tiiem. In 
addition, their latest adaress of record will be more recent. 
Further, those who did well, whether as a result of treatment or 
spontaneously, are more likely to be living a convehtional.lifec with 
all that implies about less moving from one address to another, 
more contact with wife and relatives, more community participa- 
tion, and consequent ease of location. At the same time, those 
whodidUbt do woU may be back iri'treatment; or^in a^p and 
may also be ifound easily. Since ease of location is almost certain 
to be associated wiLh extremes ox outcome, recovery of nearly all 
the ca^es is necessary to avoid having a biased estimate of pro- 
gram effectiveness. 

Altliough in general cKents with poor treatment results will be more 
difficult to locate, the most extreme treatment failuresr-persons 
who are dead or in prison—are easy to document. Records show- 
ing their failure are found fairly easily. For this purpose the vital 
statistics divisions in the state departments of health can be very 
helpful. By submitting names and dates of birth, it is possible to 
verify death certificates or obtain birth records-, which in turn 
siq)piy names of parents and places of birth. Such information also 
helps the interviewer determine whether or not he has found tho 
correct subject within the death or prison records. 

This problem of locating respondents is important because a 
foUow-iq? of clients which does not locate almost all subjects 
within the chosen samples will produce results that are biased 
both positively and negatively. Those laost often missing may be 
the less extreme failures: namely, those clients who returned to 
aridiction without coming to further public notice. 
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COLLECTING DATA PRIOR TO DISCHARGE 



Intake^data At the outset, it is necessaxy to ask what kind of data may be 

need?^ to locate clients at some later time. Planning for data coH 
lection can greatly reduce the difficulties of later fpUow-iq). To 
assist in the locating effort, it is extremely helpful to collect some 
basic information routinely when *he client first applies for treat- 
ment. Such infomation might include items like tibie following: 
(1) address and telephone nuDiber; (2) social security number; 
(3) occupations held; (4) aliases used; (5) date and place of liirfh^ 
(6) parents* names and birthdates; (7) siblings* names and birtti-^ 
dates; (8) name and birthdate of wife or girlfriend; and (9) namep 
and birthdates of children. Having such data as these ir the file 
will not only help later in using agency files in a locatiug effort, 
but win ^so help the interviewer determine whether or not the 
correct person has been found before proceeding with the interview. 

Planning for Later A few years ago, a collection of information of this type would^have 
Access to Records been adequate to assure locating almost every sample member 
even after years had passed. The nanies and ^birthdates could be 
checked through police and school records,, and through voter 
registration and drivers* license registration, until a current 
address of a relative or friend on the list was d)tained. That 
person could then be asked for the subject's current address. 
However, for various reasons, many of these agency records are 
no longer open to the researcher without written permission from 
the subject. 

Thus if possible the client at intake should provide the researclxer 
with permission to look at all the peirtiner'^ records. It is heipfal 
at the outset, then, iu ask the client to sign a permission slip to 
look at vital statistics, credit ratings, police records, hospital and 
clinic records, drivin^^ reco^s^ welfare records, unemployment 
compensation records, and ochool records of his children if they 
are old enough. It should be emphasized that the permission slip 
should be ctotained -^d the very first appearance of the client in the 
program office. Ouierwise, dropouts will be harder to. follow than 
those who continue in the program. This means that the client will 
need to be told immediately that there is an interest in following 
him later, and will need to be assured that l^ter attempts to locate 
him will be extremely discreet. (See Chapter 5 for suggestions 
about how to do this. ) 

Obtaining such a signed consent form presents both psychological 
and ethical problems. First, requesting the permission described 
above may cause the client to feel he is being pressured to cooper- 
ate. Your attempt fo obtain informed consent may imply to him 
that he must do what you ask in oixier to be admitted into the pro- 
gram. It is important to make clear that his receiving service is 
not in any way contingent upon his participating in any foUow-Jjp. 
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Ethical Risks Second, even though you may be successful in gaining proper 

access to other agencies' records, certain ethical risks and con- 
siderations will inevitably arise. Again, matters such as these 
are discusaed more fully in Ch^ter'5, and it is esbential thatjou 
follow the procedures e3q)lained there. 

COLLECTING DATA AFTER DISCHARGE 

if you have not foreseen that you would want to do a follow-up on 
your subjects, and iiow decide to do so only after the individuals 
have already left your program, your task will be more difficiilv, 
but not impossible. Systems u^ed to locate hard-to-flnd persons 
such as drug abusers may be conveniently grouped into four some- 
what overl^ping categories: (1) public records ami frieiiis; 
(2) the criminal justice system; (3) the "helping services" system; 
and (4) the sub-culture of ^addiction* Each of these ^will be dis- 
cussed in turn. Wherever possible, these efforts should be 
centralized. 

In launching a search through these records, you should use a 
"search sheet" for each person you are trying to locate. Each 
new item of information found— such as correction of birth-date, 
a middle name previously unteiown, an alias, or a relative's name 
or address— should be entered on this "search sheet" to be used' 
when nioki*:^ Mquiiles at the next place. The more complete the 
identifying it^^ormation you can give, oie better the chance of finding 
the records that you seek, and of recognizing that a record with 
incomplete identifying information does indeei belong to your 'Uost" 
subject. 

Public Records Public records are usually the first source to be eK>ployed because 
and Friends they a.^ so readily available. To begin, you might use city direc- 

tories and the telephone company !s directoiry listings, plus fne 
help of information operators to try to find the subjects— -or, if 
they are not listed, members of their families or perhaps girl- 
friends named in their records. K this fails, you might try the 
street address directory which may bjs rented from the telephone 
company. Because this directory lists numbers by residence 
instead of name, it allows you to call former neighbors who might 
have information on where your client has gone. 

Another major source of help is ihe United States Post Office. Not 
only may letters be sent to subjects either directly or in care of 
someone else, but also the postal system's records of address 
changes are very useful. For a small fee, the post office will 
check and correct up to 20 names and addresses if there is an 
axmn^l change-of'-address notic3 on file. The "special delivery/ 
return -receipt-requested" service is especial!' helpful, because 
you learn the name of the person who accepted ttte lettrv. Moro- 
over, a special delivery letter makes die study seem important to 
the subject, so that it is more likely that he will read the letter 
carefully. Finally, it may be helpful to talk to the local postman 
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assigned to the area in which he is thought to live now or from 
which he moved. 



The Criminal 
Justice Svstem 



Police and Prison 
Records 



Federal Records 



The Helping 
Services System 



After leads emerge from one of the above sources, locators can 
make home visits and talk with friends^ neighbors, and occasionally 
landlords for,personal leads. The local bar may also prove to be 
a good resource. In addition, the state motor vehicle bureaus 
may be quite helpful, since most j^ouiig men have driver's licenses 
and the application requires birth date and current address. 

Many if not most drug abusers, especially circotic addicts, 
eventually become known to the various local, state, and federal 
law enforcement agencies. These agencies can be contacted- if 
routine methods of finding a subject have proved unsuccessful. 
Issues of cpnfidontiality are of great concern here, and all the 
recommendations about privacy discussed in Chapter 5 should be 
considered carefully, particularly those about not divulging infor- 
mation beyond that already known about your study population. 

Local police arrest records geiierally include dates of birth, dates 
of arrest, and addresses. They may also include calls for ambu-- 
lances and reports of thefts. These always inciude addresses, but 
may be hard identify if the client's name is a common one, since 
they do noi include birth dates. If any of your subjects has been 
convicted of a felony, the social histories in state and federal 
prison records may contain information that is helpful in locating 
these subjects. Particularly useful are the names and addresses 
of visitors during any period of incarceration. 

In addition, the Federal Bureau of Investigation accumulai3S 
recozrls from all the states. Access to these recqrris is. valuable 
if some of your subjects have moved out of state during the follow- 
up period. Also, the cooperation of the Bureau of Prisons and the 
United States Parole Board can be veiyJielpful. Before these 
agencies will work with researchers, they will require-that their 
needs for the rrotection of data be met. Although many subjects 
may not currently be known to these federal agencies , their records 
may include informaiion not available in your treatment record. 
Once a subject has been located in federal records, you can contact 
the last arresting agency a.r • leara, from them what the disposition 
of the case was. If the person has been placed on probation or 
Incarcerated and then paroled, the state probation and parole office 
is varj^ likely to have a current address. 

In addition to the vital statistics divisions in the state departments 
of heal%, mentioned previously, rosters of other agencies which 
can be consulted in efforts to locate subjects include Medicaid, 
sccial and welfare agencies, mental hospitals, and Veterans 
Administration hospitals. These records are a useful resource in 
locating clients but they may have added value in that checking the 
complete list of subjtots in the f Uow-up study against the current 
and past rosters of these agencies can be used as a way of measuriag 
treatment success. 
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Selectivity is advisable when sending names to other states for 
checking against their records. However, many out-of-state 
agencies prove very cooperative In searching their records. 
When they Identify an Individual, they may also search further in 
base flies to secure addresses and next-of-kin Information* 

Finally, visits to Various drug abuse programs may help to locate 
clients who have moved to a different program since leaving 
yours. Remember that you must be careful not to divulge con- 
fidential information even when talking to anoiher treatment pro- 
gram. 

The Subculture In addition to the methods described thus far, you may also seek 
of Addicts aid from subjects already Interviewed. For example, after a sub- 

ject has completed his interview, he might be asked whether he 
would like to help find some still unlocated subjects, and a smaU . 
fee might Dt? paid for successful leads. Frequently persons who 
attended the same treatment program know each other or^have 
friends in coiiimon. The following technique has proved useful to 
researchers in^ths past. You might read the list cf unlocated per- 
sons aloud, giving only .the last name or only a nickname. If the 
helper recognizes a name, he Is .^sked to supply a first iiame or 
an address or the area of the city cxaquented by the unloca*"ed per- 
son. What he says is recorded. It the Information proylded by the 
helper matches the information already at hand, it may be as- 
sumed that you are both referring to the same person. But the 
helper should not be told which are ''hits" and which are ''misses. " 
in tills way, no coniidence is betrayed to the helper, and the burden 
Is on him to convince the investigators that he really knows the 
person nought. In this situation, top. It is Important to make clear 
that everything said is protected by the laws of confld«3ntlallty as 
well as by your own g <arantee of privacy and anonymity* 

It should be e3q)lained to these helpers that you want to make con-- 
tact with the unlonated subjects for an interview; therefore, they 
should respond only to the names of persons whom they know well 
enough to find directly. Experience shows that interviewed subjects 
are typically quite cooperative and willing to help If they can. Ihe 
above technique can be extended by requesting information from 
other lormer addicts and offering them the same financial Incentive. 

CONFIDENTIALJTY, PRIVACY, AND PROTECTION OF REPUTAT50N 

The importance of confidentiality, privacy, and the protection of 
the reputation of study subjects and their families cajmot be too 
greatly emphaslzeu. These matters should be addressed at everj' 
stage of the research process — when locating subjects, when making 
personal contact with them, when gaining informed consent and 
conducting the interview, and finally when processing the Interview 
data. Experienced researchers have found that It In possible to 
fulfill their responsibility to observe confidentiality, while still 
getting the data they need. 
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In order to fulfill this responsibility, two general operating prin- 
ciples should be followed throughout all the stages of the research. 
_First, sample subjects should never be^ identified to any person or 
agency a^ narcotic users, unless this information is airsady 
known to be in their possession. Two corollaries of this are as 
follows: (1) never rc/eal the drug abuse nature of the research 
to any person or agency that knows the subjects but doefj not kuow 
about their drug use; and (2) never revsal the exact identity of a 
subject when the drug abuse nature of the research is known. 

A second guiding principle is never to reveal to any person or 
agency the exact location of ^any sample subjects who have been 
located. Indeed, you should never conclude an inquiry at any - 
agency or with any individual that leaves them in possession of 
more information abont a subject than they already had when they 
were first contacted. 

If possible, it is desirable to conduct the survey under the auspices 
of a broad umbrella agency, such as a health department or a * 
serial services organization. The intention is not to hide the trtxe 
nature of the research project from the subjects, but rather to 
protect their reputations and privacy* Any possible rijsk of mis- 
leading subjects in this first contact is well worth the price of 
losing the one or two who might feel betrayed if someone else 
were to find out about their history of drug use. 

There are at least three workable approaches to the task of creat- 
ing plausible yet non-threatening auspices for your study. One is 
to work through the office of the medical director if your^agency 
has such a person. Emphasize that the study has medical backing 
and seeks data related to health. A second approach may be ap- 
propriate if your medical director or another physician within^ 
your agency has an active relationship with the local or state 
medical society (or both). In such a situation, investigate the 
possibility of the society's sponsorship together with the physician's 
personal involvement. A third approach is to speak generally 
about a 'Tiealth survey" and to state that your study is part of an 
overall effort to acquire information about such factors as health 
needs or treatment facilities. 

An initial letter is usually sent to all subjects explaining the study 
md expressing the staff's wish to interview them. This letter 
should be worded very carefully to interest the respondent and to 
avoid scaring him off. In particular^ the letter should not contam 
any drug-related terms or any references to drug use, drug abuue, 
or research about drugs. 

The following letter was actually sent to the subjects of a recent 
survey. Care r^as given to using stationory whose letterhead was 
not threatening: it simply identified a neutral granro-administra- 
tion agency under v/hose umbrella the survey was conducted. The 
text of the letter simply states that the purpose of the project is to 
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study changes that occur in people *b lives, and that respondents 
have.been.selected at random. The name of the study directpr,.^ 
the source of supporting funds, premise of payment for coopera- 
tion, and guarantee of confidentiality of information are all 
specified in the letter, vfhioh spears below: 

Date 

Dear , 

You have been specially selected to be a participant 
in a research pro}t'K3t that we are conducting. We are 
(name of agency), a non-proifit research organization. 
This research project is under the direction of 

and concerns the changes that occur in 

a person's life and the effect they have on his well-being. 
Your participation in this study will involve giving us an 
interview, for which we are going to pay:yQU . 

We would appreciate it if you would,give us a call as 
soon as you receive this letter. If you are but of town, 
call us collect. This will allow us to explain more fully 
what the interview involves as well as find. a convenient 
time to interview you. There is usually someone in our 
field office every weekday between 8:30 A.M. and 4:>:0 
P. M. If we do not hear from you after a reasonable 
length of time we will telephone or call on you to explain 
further what our research involves and why we want to 
talk with you. Our telephone number is . 

Sincerely yours. 



Another example of a letter of introduction for interviewers appears 
in Appendix F. 

DIRECTIONS FOR IN-HOUSE STAFF 

Tasks Which Office The office staff can take charge of handling telephone calls and 
Staff Can Handle searching agency recorqs. As noted earlier, the initial letter you 
send to your sample subjects will presumably ask them to call 
your office to make an appointment, or to obtain answers to any 
questions they may have. The office stafi' should have a copy of 
this letter always at hand for ^hcir own reference, plus written 
instructions about the procedure for ro.aking appointments, and a 
list of questions tJiat respondents are likely to ask. Answers to 
these questions need to be provided also. This information and 
advance preparation enables the office personnel to handle other 
telephone inquiries as well, especially those made by agencies 
and certain individuals whose assistance the study requests. It 
may be helpful to install a special telephone line for the duration 
of the study so that all calls related to the study can be received 
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at one number. Than the staff will always be prepared to respond 
appropriately when the designated telephone rings. 

People who imswer the phone must be prepared to answer the. 
questions of respondents who will be calling in. Scripts prepared 
to guide secretaries in answering telephone calls from study sub- 
jects should be carefully designed. Particularly they should not 
contain any reference to drugs, drug use or abuse,, or study of 
drug users; there is no guarantee that the person on the phone is 
really the research subject even though he may say he is. Sec?- 
retaries and research assistants should be instructed never.to 
bring up the subject, and not to mention any of the* information the 
.study already possesses about the individuals in the samplei 
Rather, they should be instructed to repeat only what the letter 
has already comnaunicated. They should also be instructed to say 
that they are not at Uberiy to divulge confidential sources' of in- 
formation, a principle the subjects are sure to understand inas- 
much as this same protection would be extended to any information 
given by interview subjects. Finally, in answering the telephone, 
SBcetaries should always identify the office with neutral woi^ 
such as "Social Research Center. " Not until a sample subject 
presents himself at the study office or meets,an interviewer in an 
off-site interview should tiie complete nature of the research 
project be reveabd. The purpose of these procedures is not to 
deceive the client, but rather to protect him from unintentional 
e:q)osare. 

Below are examples of prepared scripts thsl were actually used ill 
a recent survey. Note that they contain no references to drugs, 
drug use or abuse, or study of drug users. 

H OW WAS I PICKED ? 
W HY WAS I PICKED ? 



"Your name was selected from a list of many who could 
have been chosen, by a scientific procedure called "random 
sar -pling. What this means is that you will be used to 
represent a number of people who are much like you, and 
instead of interviewing all of those people, we have- chosen 
yo'd. Your selection was a matter of chance. Any person 
could have been selected, but your name was the one that 
happened to come up. This is the way all of the people who 
are a part of this study have been chosen. We want to inter- 
view everyone because if we should fail to interview someone 
who has been selected, not only will that person be mipslngr 
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from the study, but all of the other people^ like him 
will be left put as well. And that would not be good. 
-For-this-reason-itdSHmportant to get your cooperation 
and to set up a convenient time for your interviev/. 

VfflAT QUESTIONS .ARE YOU GOING TO ASK? 
WHAT DO YOU WANT TO KNOW? 
WHAT IS THE INTERVIEW ABOUT? 

»*In general, the kinds of things that we will be 
asking about are the changes in your life and how 
your health has been in the last two years. If there 
are any questions that you do not want to answer, you 
dorit have to, or if you should decide you would like 
to stop the interview for some reason, you will, of 
course, be free to do that at any pioint. Naturaiiyt 
we would like you to give us an interview that4s/as 
complete and accurate as possible. 



WHAT DO YOU WANT TO KNOW THAT FOR ? 
WHAT ARE YOU GOING TO DO WITH THE 
INFORMATION? 



"The information we get from the interview should 
help us to xmderstand the adjustments that people have 
to make in their lives wlien things change for them. 
We also'want to see what effect^this.has.on.thein, 
health and well-being. Increasing what we know about 
these things may make it possible to help people 
through difficult changes in their lives. " 



WHERE DID you GET MY NAME/ADDRESS? 
HOW DID YOU GET MY NAME/ADDRESS? 

*We have names from several ^encies, and In 
this study the people doing the study will not know 
from v/hich agency your name was chosen. We must 
protect the confidentiality of our only tv/o sources of 
information, the agencies we have dealt with and tL^ 
people we interview. However, I can tell you that 
your name was selected from a list of ipany people 
who have used various kinds of services provided by 
agencies in X (City),'* 
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^HOW^LONG WILL THE mTERVIEW TAKF? 



''Some run longer than others, however, it won't 
be more than a couple of hours. We want to pay you 
for your time. We will pay you X dollars 
at the end of the interview. " 



HOW MUCH ARE YOU GOING TO PAY? 

"As we said in our letter, we will pay you for 
givjng lis an interview. You will-be-given- X 
dollar s^in cash upon completion of tl^ interview." 

WHO IS DOING THIS STUDY ? 

"The study is being conducted by X 

^ency, a non-profit research ovganization, AlTthe 
information that you give us in the interview will be 
used for research purposes only. Your name will 
not be attached to the interview, thus making it 
completely anonymous: Furt&r, all the information 
we collect is kept strictly cpnfidentialr your privacy 
in this regard is protected by state and federal laws 
governing research studies. " 



WHAT IS THIS STUDY ALL ABOUT ? 

"Basically, the study is concerned with the changes 
that occur in a person's life and the effect thoy have 
on his well-being. The entire interview wiii take 

X amount of time. It just is not possible 
to explain the whole thing to you over the phone: when 
you come into our office you will be given any further 
information that you want. " 



HARD-TO-FIND SUBJECTS 

Some subjects are especially difficult to locate because of special 
complications in their life situation, or because of special fears 
about being sought. For example, a person who gives up drugs 
and turns instead to alcohol tends to become very mobile. Alco- 
holics generally move about a great deal in erratic patterns that 
are hard to trace. Elusive movements are characteristic of per- 
sons who are still using drugs illegally and therefore experience 
a constant fear of arrest. 
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In order to-provide -detailed suggestions about methods for locating 
hard-to-find subjects, actual case studies are included in Appendix - 
,G..to,thisjnanual... These illustrate techniques that are use- 
ful in handling speciafprobleicns: exceptional fear of arrest, 
alcoholism, and unusual reluctance to cooperate. 

For the researcher, the matter of reluctant subjects raisjes the 
question of when to give up. Of course, this question "is related* 
to considerations of cost-effectiveness. As noted In Ch^ter 3, 
a response rate of at least 80 per cent should be obtained in order 
to have meaningful results from a survey. Some refusals are 
inevitable, and,a completion rate much over 90 per cent is prob- 
ably an unrealistic goal. Interviews on the first 60 to 70 per cent 
of subjects win be relatively ine:q)ensive; the next 15 to 20 per 
cent will cost appreciably more. But moving from 80 per cent 
completion to 90 per cent may cost twice as much per case as did 
early interviews, and every percentage point above 90 will cost 
perhaps three to five times what early interviews cost. A study 
with high recovery rates cannot be done cheaply. 

PROBLEMS AFTER LOCATING: BROKEN APPOINTMENTS 

Even if you are successful in locating respondents and in getting 
them to agree to an interview, this will not guarantee that an in- 
terview wilLbe obtained. Broken appohitments are an especially 
common problem in such research. In one survey of drag abusers, 
41 persons out of the 286 living subjects ^^ho were eventually lo- 
cated broke at least one appointment. Whenever this occurred, 
the interviewer waited bstween 30 and 45 minutes. If the subject 
still"had not appeared or telephone'^ to c^Kp^dnhis lateness thp 
interviewer then made follow-up o^orls. '/nus i: the respondent 
does not show up, the interviewer or loc/itor is aole to contact 
him again. Generally, such a conversation would go as follows. 

The call would be made, and you would identify yourself and ask 
to speak to the subject. If the subject is not there, a message may 
be left stating that you had called a^d would call back again. If 
the person answering the phone kn'^ws that the subject has been In 
contact with you and had an appointment, he may volunteer some 
information about where the respondent is or when he may be home. 
If the information indicates the subject may still intend to be inter- 
viewed (for example, "he forgot" or "he called and said he couldn t 
make it'% then you would respond in a positive way, stating that 
you would call back again and make another ^pointment that was 
more convenient, and that the subject should not worry about having 
missed the appointment. ("We'll just set up another one at another 
time. ") But if the person answering the telephone appears not to 
have any knowledge about you and does not recognize you when you 
give your name, then the only message to leave is "I will call back 
later. " 
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On.the other hand, if the subject is present when you call, gen- 
erally 2ie following approach can be used: 



"This is Mr. 



from 



Center. 



I have here on my list that we have an appointment 
today for an interview. Now, you probably forgot 
all about it, so I just thou^t I'd call to see if you 
were delayed or on your way, and see if we could 
make the appointment again for another time ' Aen 
you think you can come in* Now, would tomorrow 
morning or Friday afternoon or Saturday morning 
b« better times for you than today, or do you think 
^6 stiJl bive time fc you to come down here today? '' 

If you fj.spect that transportation mig^it be a problem, another 
tactic ihat can be used is to center the conversation around that 
factor. For example: 

'1 thought that you might be having a problem getting 
a ride here, so I thought I'd call and tell-you^that 
maybe you could take a cab or someone could come 
out and pick you up. If you take a cab, you know, you 
just have them stop in front of the office and sonisone 
inside will come out and pay the cab fare for you, and 
we'll also pay for your cab fare back home. 

It is also a good idea to suggest plausible excuses to subjects for 
not keeping their appointment. You might su^'gest that probably 
something had come up at the last minute which they had been 
unable to foresee when they made their appointment. Working 
overtime, unexpected compaior, or illness in the family fall into 
this convenient category. 

The emphasis in this approach to "no-shows" is io-accept what- 
ever excuse the subject wants to supply for not showing up, or to 
offer him an e-V3use if he does not volunteer one: never question 
whether he really intended to come in or not. Generally, your 
approach should be friendly and understanding. But if the person 
misses more than two appointments, you should take a different 
approach— for Instance by telling him that you had to wait for him, 
and that his not coming meant you had to spend money that you 
would much prefer to spend in other ways, such as the respondent's 
travel expenses, refreshment, convenience, or comfort. 

The purpose of the understanding approach described above is to 
allow you to coniplete the interview eventually. However, in a 
few cases it may even be necessary to change the site of the pro- 
posed interview in order to secure the interview. In one case, 
this might mean going to a respondent's home after he had re- 
peatedly missed appointments. In another case, it mi^t mean 
arranging to go to a drug treatment program, and waiting for him 
to show up for his methadone. In a third case, it might mean 
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picking him up after work and conducting an interview at that 
point. In still another case, it migjit mean meeting him in a 
restaurant and conducting Hhe interview tiiere. 

The Appeal ~ In the event that the subject indicates that he has had second 
to Reason thou^ts about coming for an interview and prefers not to par- 

ticipate, you would.shift your tactics. Instead of trj^ng to.make 
ah appointment in the immediate future, you would talk with him 
about how important the study is and why his participation, is 
needed, adding that you would like him to think about it and will 
call him back in a few days. Generally, this appeal to reason 
allows you to keep the lines of communication open, and In some 
cases this maneuver allows you eventually to secure the inter- 
view. In other cases, however, the stb ject may stubbornly stick 
to his guns and declare that he has decided he does not w^t to 
participate. 
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Goals of Data The goals of data collection for most surveys are quite strai^tfor- 

Collection ward: you have defined a groxxg of people to study, you wish to find 

out certain things about that groi:^, and you have decided that the 
best way to get information is from the pec^le themselves. The 
goals of data collection are then as follows: (1) to collect data that 
are accurate; (2) to collect data within the restraints of the research 
budget; and (3) to collect data from as many respondents as pos- 
sible (discussed in Chapter 6). 
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. The data:Collected by any survey should represent the best Factual 
^iofprmation which respondents .can^prpylde,. and their most truth- 
ful opinions. To facilitate this process, you need interviewers who 
will help the respondents feel comfortable in the interview P^uation, 
so that they respond fully to the questions which your study is 
asking. The care ypu take in selecting and training interviewers 
helps in obtaining* data that are^of-good quality. 

In general, data collection's the most expensive part of survey re- 
search because it requires coordinating jie work of many people. 
It is important to budget realistically for good data collection. K 
is also important to manage the data collection effort carefully so 
that no money is wasted in ineffectual efforts to complete cases. 

Planning for effective data collection to meet these goals is not so 
simple as it may first appear. The data collection procedure re- 
quires integrating the services of a number of interviewers who 
work independently, out of sight of those who designed the survey 
and will analyze the data. 

This chapter suggests a number of factors which ^he survey admin- 
istrator should consider in controlling the quality of the data col- 
lected by interviewers, within the overall constraints of the project 
budget. 



CHOOSING INTERVIEWERS 

1x1 most interviewing of drug program clients there are two distinct 
tasks: (1) locating ex-clients, and (2) conducting thie interviews. 
The skills required for these two tasks are related, but not identi- 
cal. Fortunately experi'>nce shows that the.people who can learn 
to become skillful in finding hard-to-locate respondents are usually 
the same people who can conduct good interviews. E:q)erience on 
a number of large scale research projects suggests some charac- 
teristics which the researcher should keep in mind when hiring 
personnel for locating and interviewing resp mdents. 



INTERVIEWER CHARACTERISTICS 

Education Interviewers on drug follow-up studies need to be somewhat more 

capable than might be true in other studies, because drug follow- 
up studies tend to have lengthy questionnaires that requir:e some 
sq)histication to administer. The interviewers need to be able to 
work very carefully with a respondent to obtain detailed information 
about his life since he left treatment, using a technique called 
'^probing, " which is discussed in Appendix J. One way to help 
assure that your interviewers will have the necessary ability is to 
require that they have had at least some college. 

Personal Qualities A good interviewer will not only be intelligent, but will also be a 
person who makes the respondent feel comfortable. People who 
are overbearing, aggressive, or' hostile do not make good 
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interviewers, and neither do people who are shy. The best inter- 
viewers are people who feelCcomfortable in relating to.others, 
who are not dependent on the opinions ol others to maintain their 
personal image, and who find non-response or hostility in others 
a challenge rather than a threat. But most important, interviewers 
should be people who will not judge the.behavior of any person they 
interview, no matter how unusual or antisocial that behavior may 
he. 

Matching the age arid sex of respondents and interviewers does not 
appear to be very important* Most of the respondents in drug re- 
search surveys have been men because most of the clients of drug 
treatment centers have been men* However, it is interesting to 
note that surveys of treated clients using interviewers of both sexes 
have found no difference in data quality whether male or female- 
respondents were interviewed; 

On tie other hand, matching the race or ethnic background of re- 
spondents and interviewers is sometimes important. %)anish 
American respondents with a lack of facility with. English may re- 
quire the assistance of a bilingual, Interviewer. In addition, com- 
munity standards and mores may make it difficult for "outsiders'* 
to be accepted and this in turn may cause the interview to be less 
accurate, if it can be completed at all. For these reasons, it is 
a good rule of thumb to hire interviewers cfrom the same back-* 
ground as the respondents. If the oample has. known proportions 
of various racial/ethnic groups, interviewers liai^ht be hired in 
those same proportions and an effort made to match interviewers 
with respondents of the same racial/fethnic groips. 

Researchers studying drug program clients\ave generally used as 
interviewers persons trained in the treatment of drug abuse, 
thinking that they would have an easier time' locating and getting 
accurate information from ex-clients. However, several large 
studies recently have shown that drug clients and ex-cliehts can be 
successfully located and interviewed by persons outside the treat- 
ment professions. The discrepancies between records and inter- 
views with drug treatment clients In these studies have not exceeded, 
in number or kind, the discrepancies expected in interviews. on any 
topic. Indeed, outside interviewers may even have -special adr 
vantages in that the respondent may feel more certain that his 
responses will not get back to personnel in the treatment program 
as coming from him. 

A related concern of many drug treatment researchers In the past 
has been that respondents might mislead an interviewer unless the 
interviewer were familiar with the drug culture, and were able to 
speak to the respondent using street language. While it is extreriiely 
important for the interviewer to be comfortable and interested in 
what the respondent is saying, it is not important for the inter- 
viewer to be an insider in the drug culture. When the language is 
not familiar to an interviewer, most respondents will translate. 
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On the other hand, when a respondent wtshes to distort his opin- 
ions or to be misleading^ even the most sophisticated interviewer 
can be misled: it is not possible to force.anyone to tell the truth. 



If at all possible, it is advisable to use interviewers who are not 
connected >yith the treatment center. However, for financial or 
other reasons, it may be necessary to use staff members of the 
treatment center to administer interviews. In tihese cases, special 
precautions are advisable to minimize distortions in survey re- 
sponses. The client or ex-client v/ill be worried primarily about 
his own safety. He may distort his answers if he -suspects that 
they may in soma way harm him. For example, the respondent 
may fear that the interview will affect his treatment status, job, 
or welfare status. Since he knows that treatment personnel have 
connections with the program and the community, the respondent 
miay not believe that the researcher will use the information for 
research purposes only. Both outside and inside interviewers 
must be aware of the problem of trust, but it is much -more critical 
when the interviewer is an employee of the treatment center. 

Therefore, if it is necessary to use members of the drug program 
staff for interviews, you mi^t give special consideration to the 
possible problems and conflicts of interest arising from the. 
following. First, the interview may repeat questions asked of the 
client at intake or during treatment. If he has lied previously, he 
may be uneasy about changing his story. Second, the interview may 
ask for attitudes toward the treatment center which the client may 
be reluctant to give to a member of that center. Third, the inter- 
view may ask about illegal behavior, sudi as' selling drugs, stealing, 
or receiving welfare payments to which he is not entitled. The 
client may be reluctant to have such activity known to the program. 

Interview Site Some special interview procedures are set out here as examples 

of procedures that may be developed to minimize the danger of 
distorted responses where staff interviewers are used. First, if 
the respondent is a client, the interview should be held in a neutral 
area—not the room where the respondent may have seen a 
coimselor or gotten treatment regularly. If he is an ex^-client the 
interview should be conducted away from the treatment center. 

Reassuring the Second, a special effort should be made to reassure the respondent: 

Respondent (1) that the information given in the interview will never be used 

to affect his treatment status; (2) that all personal identification 
will be removed from the document; and (3) that the interviewer is 
committed never to reveal aiqrthing in the interview to anyone else. 
If your institution has a human rights review committee, it maf re- 
quire that the respondent be given a statement to sign which em- 
phasizes the voluntary nature of the interview and ksks him to 
accept the institution's guarantee to use the data confidentially. Of 
course, it is crucial that these promises be kept. 
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Third, interviewers should be chosen from among those staff 
members who not only meet the criteria for jgood interviewers but 
who also have as neutral a relationship as possible to the clients 
to be interviewed. It is far better to have an interviewer who is 
neutral than to have one who has a strong positive image among 
clients. A respondent may not feel free to egress his criticisms, 
9f a program to a staff member he likes and whose feelings he 
does not wish to hurt. Conversely, he may hesitate to speak freely 
to a counselor with whom his e3q)erience has been negative-- 
especially if he imagines, that the counselor is in a position to 
affect some part of his life adversely. TfiereJore, ^a neutral inter- 
viewer would appear to be the best selection.. 

Researchers. have occasionally used ex-addicts, who are often 
staff members, as interviewers on follow-up studies^ in the belief 
that thes^ individuals, because of their understanding of the drug 
culture and the addict's life, may be able to elicit more accurate 
Information than other interviewers. However, evidence from a 
number of studies shows that it makes little or no difference 
whether data are collected by ex-addict interviewers or by others. 
You should apply the same criteria to ex-addicts as to other inter- 
viewers—especially those criteria emphasizing the neutrality of 
the interviev/er and the confidentiality of data. In particular, you 
should be certain that any ex-addict Interviewer will be able to 
avoid judgement and refrain from undue identification with the re- 
spondent. These tendencies will have a bad effect on the data 
gathered by any interviewer. 



THE SELECTION AND SUPERVISION OF INTERVIEWERS 

It is assumed that most programs will have to use "in-house" staff 
as locators and interviewers. For those programs planning to 
recruit interviewers from outside their staff, appropriate recruiting 
and supervisory procedures are presented in Appendix H. 



TRAINING INTERVIEWERS 

Techniques of There are some generally accepted interviewing techniques which 

Interviewing are applicable to most surveys. These techniques are very dif- 

ferent from those used in counseling or personnel interviewing, so 
that even interviewers who have had considerable training in these 
areas will still need to have additional training. These techniques 
are described in detail in several training manuals of major survey 
research groups. 

Training Materials The University of Michigan Manual is available from the Publica- 
tions Office, Institute for Social Research, University of Michigan, 
Ann Arbor, Michigan 48106. The National Opinion Research 
Center (N. O.R. C. ) manual is available from that agency ^s library, 
6030 South Ellis Avenue, Chicago, Illinois 60637. Both of these 
manuals cost under $10. 00, and they can be used as a basis for 
interviewer training. Centers with sufficient funds may even wish 
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to use one of such academic survey groups as oonsultants in 
training,. 4 list of organizations which have active field staffs and 
train many interviewers each year is included in Appendix !• Some 
sample training materials for the interviewing and locating of re- 
spondents have been included in Appendices J and L* 

Some of the most important principles of interviewing have been 
summarized here as a guide for those researchers who may wish 
to undertake their own training program for interviewers, possibly 
through actual training classes, discussed later in this chapter. 

It is important for an interviewer to relate to the respondent in a 
manner that is pleasant, but neutral and businesslike. The ex- 
change between interviewer and respondent should not become 
social. For example, a respondent may want to tell an interviewer 
about his problems, but the interviewer should not become per- 
sonally involved in helping him. (Chapter 5 of this manual dis- 
cusses the advisability of referrals in such a situation. ) If the 
respondent talks about subjects other than the interview questions, 
an interviewer should make tactful interventions into the conversa-r 
tion to retixrn to the tqpic of the interview. For instance, the 
interviewer might say, "It is interesting to hear about your oper- 
ation. Perhaps I can help you answer the question about your 

medical expenses if I reread it " Further, an Interviewer must 

resist the temptation to accept inappropriate hospitality from a 
respondent. It is all right to accept a cup of coffee, but the com- 
mon effort of the interviewer and respondent should be to work 
together to complete the interview. Anything that interferes with 
that process or makes it more difficult should be avoided. 

A second principle of interviewing is that the questions on the inter- 
view schedule must be read EXACTLY as they are written. By 
doing this, the interviewer is ensuring that each respondent is 
answering the same question. This is much more difficult to do 
than people usually imagine it to be. But it is important to em- 
phasize that a slight chaise in the wording of the question can 
change its meaning altogetliei. For example: "When did you go 
to the treatment center? " is a very different question from "When 
did you last go to the treatment center? " Clearly, it will not be 
possible to make valid comparisons of the survey responses if the 
respondents have not in fact answered the same questions. 

A third principle of interviewing involves the use by the interviewer 
of a technique called probing, which helps the respondent give 
fuller and more con^lete answers. Probing is a way of asking for 
additional information, or for a fuller description of the respondent's 
opinion, or for a clearer answer to^a question, without Influencing 
his answers. Probing techniques to be used by interviewers are 
discussed in greater detail in Appendix J. 

Interviewers should first be tau^t these general principles of 
interviewing. Then they should learn the particular information 
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they need for the survey they are adminlofcering. For example, it 
is helpful as a rule for interviewers to Igiow the purpose of the 
questions iia the survey docunibiit^ They k W ne^ to have a close 
acquaintance ridf only with the flow of the survey and its "skip 
patterns" (where the next question depends on the answer to a 
previous question), and the kinds of probes that apply to various 
types of questions, but also with the possible problems^^which may 
arise wiien interviewing respondents both at the center and in the 
field. Some of these problems are discussed later in this chapter^ 
This Information should be communicated not only In training 
classes but also in written instructions which may be kept by the 
Interviewers for their reference. 



Training Classes 
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Practice Interviews 



Street Language 



Training classes for interviewers should use the teaching methods 
that apply to most adult education. The classes should extend over 
sufficient time for ample training without night-and-day meetings: 
most people do not learn efficiently for more than six or seven 
hours a day. A sa33iple agenda for a training session for interview- 
ers for a drug foUow-^p study has been Included in Appendix K. In 
addition, the teaching methods and techniques should be varied, so 
as to engage the interviewers at a hi|^ level of interest. 
Mathematica, Inc. has recently produced a video tape that is an 
excellent aid in teaching general interviewing techniques; This 
may be rented by writing to Matiiematica, TUc. , P. O. Box 2392, 
Princeton, New Jersey 08540, 

Teaching interviewers to be comfortable in interviewing drug pro-^ 
gram clients and ex-clients may be done in a number of ways. Two 
such methods are represented by the following. 

First, interviewers can practice interviewing each other, using 
the survey document, with a third interviewer observing and making 
notes. Discussion after the practice interview is helpful. Second, 
intervle^vers can interview peqple similar to the respondents in the 
actual survey. Some surveys have successfully recruited clients 
and ex-clients to participate in such training sessions as re«* 
spondents. However, If this method is used, it is wise to recruit 
more respondents than you will need: eif^erience suggests that 
there will always be "no shows, " even vfhen you are paying re- 
spondents for their time. 

As noted earlier, interviwers who are comfortable in their role 
are vot handicapped by a lack of street language. However, it can 
be helpful for int9rviewers to have a good layman's knowledge of 
various drugs and their effect?*. It can also be helpful to know 
some of the common language used on the street to describe these 
drugs, even though this language by its nature changes rapidly. 
Certainty, interviewers who have an acquaintance with this language 
and use it easily In their normal conversation can use it in the 
interview situation. On the other hand, interviewers who do not 
ordinarily use this language will find it awkward. It follows that 
such vocabulary should not be included in the interviewer training 
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sessions except to the extent necessarj for interviewers to know 
the purpose of the questions in the survey document The best 
rule for an interviewer is to use language that is comfortable and 
natural; Good interviewers can easily ask the respondent the 
meaning of any words they' do not know. 

INTERVIEWING 

Supervision of Interviewers work very independently in the field. This means 

interviewers they can easily lose touch with the goals of the research and with 

some .of the details they learned in training unless they have reg- 
ular ^ rigorous supervision by the central survey office. One full- 
time supervisor can ordinarily work with ten to fifteen interview- 
ers, who should be required to report to their supervisors every 
other day during the first part of a field period, and at least twice 
a, week during the .remainder of the data collection period. It is 
important for a supervisor to monitor the way an interviewer is 
working in the field not only in interviewing but also in locating 
respondents. Suggestions for the super\4sion of interviewers 
have been included in Appendix H. 

The interviewer is usually assigned interviews after the training 
has been completed. If the interviewing is to be done in the treat- 
ment center, the main problem is scheduling. 'However, if inter- 
viewers make contact with respondents outside the treatment 
center, they must use many other procedures to complete the 
interview, in addition to the interview techniques applicable as 
well to center interviews. 

As mentioned previously, it is desirable that interviews fake place 
in rooms not usually used for treatment of clients. It is essential 
that they should be completely private. In addition, the room 
should be arranged so that the interviewer and respondent are 
cotnfortable, with good lighting, a table, and chairs placed so that 
the respondent can sit opposite the interviewer. In this way the 
respondent is not tempted to read the questions before they are 
asked. Ash trays,, and a cup of coffee or soft drink, may help 
nervous respondents to relax. 

Merviewing is a tiring activity because it requires total attention 
by the interviewer. Thus, when interviews are scheduled in the 
treatment center, there should be a reasonable amount of time 
between them. For example, if the interview takes about an hour 
to complete, interviews should be scheduled two hours apart. The 
interviewer needs time to move around and unwtod, and time to 
edit one questionnaire before beginning the next. If you, are using 
an hour length interview, it is probably unreasonable to' expect 
anyone to complete more than four interviews a day. 

Unlike the situation with field interviews, interviewers who work 
in the treatment center ordinarily do not have to persuade a re- 
spondent to participate in the interview: it will be accepted by the 
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client as a part of the treatment process. However, this presents 
its own specialproblems, because.the-client will bring the^same 
attitude to the research interview that he brings to the treatment- 
process as a whole. A well designed interview schedule can help 
alleviate this problem. The interviewer can also help by em- 
phasizing the research purpose of this interview. The following is 
an example of the kind of introduction that could be used: 

I'm . . You are one of (100) clients 

selected at random to participate in a. research study. The 
study is completely separate from your treatment, and the 
information you give me today vrtll never be seen or Used by 
anyone who treats you here. Let me show you the question- 
naire. Notice that your name does not appear on it. As 
soon as we finish, I will check a list that shows you have 
been interviewed, but no one will be able to^connect what 
you tell me to you. Individually • The results of these inter- 
views will be reported in statistics such as "80 per cent of 
the clients here would like more vocational training. " 

Such an introduction should help the client distinguish the purpose 
of this interview from the purpose qf treatment interviews. It also 
hel^s to put respondents at ease and to calm possible fears about 
adverse repercussions which might arise if they responded fully. 

Interviewing in the field requires several additional steps: 
(1) choosing a location for the interview; (2) contacting and lo- 
cating the respondents for an appointment (see Chapters 5 and 6, 
and Appendix F, G, and L; (3) conducting field interviews; and 
(4) editing the completed questionnaire. 

Before contacting the respondent initially, the intervie^ver should 
have a neutral place in mind where the field interview could be 
conducted. Many respondents will suggest that their honie be used, 
and this is fine as long as the interview can.be held there in privacy 
and without distractions. For example, a young man living tem- 
porarily with his mother might find it difficult to answer some 
kinds of questions if she were within earshot. As an alternative to 
the respondent's home, the Interviewer could arrange space in a 
local school, library, or medical center. In addition, many 
restaurants are empty between meal times. If the weather is 
warm, a. park bench is possible, as is the interviewer's car. The 
essential condition is that the place for the interview must be 
private, and the respondent at ease. 

In Appendix L is an excerpt adapted from an interviewer manual 
that was used in a successful follow-up study of drug clients. 
These instructions summarize the manner and style that are desir- 
able for field stafl to use in contacting respondents, their families 
or their friends. Further discussion of this subject may be found 
in Chapter 6. You may find it appropriate to incorporate such in- 
structions within the training classes for interviewers. 
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Interviewers may also be given a written copy of such instructions 
^to-which^they may- refer as they contact and interview each- 
respondent* 
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Some agencies may prefer to separate the locating and interviewing 
functions. For example, yon may wish to use ex-addict counselors 
to locate research subjects and other personnel to conduct the 
actual interview. Other agencies may wish to have the same staff 
member do bpth tasks. For more detailed discussion of how to 
locate subjects and protect their privacy, see Chapters 5 and 6. 

The interviewer should be aware that several problems may occur 
while trying to complete field interviews. First, the respondent 
may not keep an appointment. People who are using drugs are 
often not very concerned about time and commitments. If the re- 
spondent fails to show up for an appointment it may only mean 
that he lost track of the time. To minimize missed appointments, 
interviewers should ordinarily meet a respondent at Ms home, and 
then take nim to the place chosen for the interview, if his home 
does not offer sufficient privacy. It is a good practice for an 
interviewer to call the respondent before leaving for the interview, 
and to arrive early. If the respondent breaks the appointment, the 
interviewer should make another one immediately. After several 
broken- appointments, the interviewer should conclude that the re- 
spondent is avoiding the interview. A supervisor should help 
decide on the next strategy from that point. Chapter 6' of this 
manual suggests some additional tactics that may be used to deal 
with the problem of broken appointments. 

Second, sometimes an addicted or alcoholic respondent will not be 
able to complete the whole interview schedule at once. (See the 
case studies in Appendix G. ) An interviewer should be alert to 
this difficulty and offer to complete the interview later that day or 
another day. Finally, the respondent may refuse to begin the 
interview at all. If this situation arises, the interviewer should be 
very careful to leave before the conversation becomes argumen- 
tative or hostile. Another interviewer may be able to persuade the 
respondent to complete the iaterview schedule at some other time. 

Procedures to be used during the actual interview have been out- 
lined earlier in this chapter in the section on ''Traiaiag 
Interviewers. " 

Once the interview is completed, the interviewer should edit it 
while the memory of the interview is sdll fresh. Editing is the 
process of checking each question to be sure that the numerical 
codes representing the answers are clearly circled, written 
answers are legible, and abbreviations.are.spelled out so that they 
will be understandable to the whole research team. 

The following editing procedures are advisable. If the interview 
was conducted in pencil, the editing should be done in ink, and vice 
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versa. No interviewer should ever enter an answer based on what 
he thinks the -respondent would have said. Nor should he ever 
erase an answer, either during or after the interview. The errors 
made b)' an interviewer using this kind of "judgment" are much 
greater than those he may make by recording Incorrectly during 
tiie Interview. 

After editir^, the interview schedule should be returned to the 
interviewer's supervisor. 

INTERVIEWER SAFETY 

Apart from certain dangerous areas in some large cities, inter- 
viewers are probably as safe contacting and lnterviewing former 
drug addicts as in most other studies. However, persons having 
to work in the poverty areas of a large city should have the ex- 
perience necessary to keep themselves safe. Many good inter- 
viewers have this savvy, even though they may never have been 
connected with the drug culture, because their life e3q)eriences 
have provided them with the knowledge necessary to make good 
judgments about where to go and how to behave. It is in^)ortant to 
have such people on the interviewing staff for any survey, but this 
is especially important for surveys of drug users. The only way 
to determine whether an individual is likely to have the rigjit back- 
ground for this kind of interviewing is to state the matter plainly 
during the recruitment Interview and listen to the response. If the 
applicant has lived in such areas or spent a good deal of time 
there, and does not feel afraid, he is probably safe. 

Some guidelines may also help interviewers to maintain their 
safety. First, interviewers should state their business clearly 
and often, and back it up by showing their identification so they will 
not be confused with drug dealers or with government agents of one 
kind or another. They should never seem mysterious. Second, 
interviewers should have a body image that is clearly open. Areas 
of the body that can hide weapons should be exposed frequently, 
and brief cases should always be available for a look by a nervous 
citizen. One very successftil interviewer, to show that he is not a 
threat, always wears his coat open, removes his jacket when pos- 
sible, and stands away from doors so he can be clearly seen 
through the keyhole. Third, in most cases, interviewers should 
share the racial/ethnic characteristics of the area in which they 
work. 

QUALITY CONTROL 

With adequate supervision in the manner described previously, 
most interviewers are honest and wr^ complete their work according 
to the specifications the project director gives them. However, 
from time to time an interviewer may take short cuts in completing 
an interview. On rare occasions, an interviewer may systematically 
"cheat" by completing only parts of interview schedules or by 
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falsifying entire interviews. Clearly, the researcher should try to 
groCect the project from these kinds of quality losses. The usual 
way to do this is to subject a prc^)ortion of each interviewer's work 
to a process called validation. 

Validation of Validation consists of contacting some of the respondents again 

interviews later, to verify that their interviews actually took place. It often 

includes asking the respondent a few questions from the interview 
tojverify that the interviewer did not skip sections of the question- 
naire. This kind of validation of intei^views with drug treatment 
clients may not be desirable when the laterviews are completed at 
the center. The fact that the hiterviever and respondent spent some 
time together in a room and emerged with a completed interview is 
validation that the Interview actually took place. However, it is 
advisable to validate laterviews conducted in the field. Interviews 
to be validated should be selected at random and should consist of 
10 to 20 per cent of an interviewer's work. 

Because treatment programs using their own staff as Interviewers 
may not feel the need to use these procedures, the detailed dis- 
cussion of how to conduct them has been placed in Appendix on 
the selection and supervision of interviewers. However, many 
program cHrectors may be well advised to use these procedures 
even with in-house staff. 

It is also a good procedure for a member of the office staff to re- 
view all interview schedules to determine whether there have been 
skipped questions and errors in recording. These errors should 
be reviewed with the Interviewer on a regular basis. Toward the 
end of a study, as the Interview load declines, it may be possible 
to reduce the size of the Interviewing staff. The best wi?y to do 
this is to release those Interviewers who have produced tiie fewest 
Interviews, at greater cost per interview, and those interviewers 
whose rate of errors is high, as judged by editing. Studies have 
shown that ineffioiencios in one area, such as cost, are often 
correlated with lower quality and low productivity. 

CONFIDENTIALITY AND PRIVACY 

Herman Melville wrote>that a confidence man is a person in whom 
one has confidence. In this sense, it is desirable for all inter- 
viewers to be confidence men. une of the first tasks in interview- 
ing respondents who may be suspicious of research, of strangers, 
or of the "establishment" In general, is to convert the respondents 
to a sincere belief in the validity and honesty of the interviewer and 
the research. Only in this way will the best data be collected. At 
the same time, however, the Merviewer must be a person in whom 
another kind of confidence can be reposed. Even after the re- 
*^earcher has taken all the precaution? that are possible to protect 
the respondent's ccnfidentiality, there still remains one danger: 
leakage of project information. 
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To minimize this danger, interviewers should be trained not to 
talk to anyone about their work--not even to family and friends. 
Most survey gro\5)S regard a breach of this rule. as grounds. for 
dismissal. However, because it is difficult for the interviewer 
not to be able to discuss interesting interviews, the time for 
supervisor-interviewer conferences should include an adequate 
amount of extra time, in which the interviewer can just talk about 
his experiences. 
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A vast body of information concerning your former clients ^eady 
exiists, even before your field work begins. This information 
exists in drug treatment programs, welfare agencies, schools, 
employment offices, and enforcement and correctional facilities. 
In addition, it is available in federal, state and city agencies such 
as social security administrations, state employment agencies, 
and city narcotics registers. The institutional data discussed in 
this chapter include all those-records maintained '^y local, state, 

or federal^agencies and p^anizationsjRfhich.Uear^cn.the-^ 

ing of drug treatment clients. 

There are two types of institutional data: (1) those describing the 
general population and populations that are similar to your treat- 
ment populations; and (2) those describing your specific research 
subjects. This chapter discusses these two types, of data in this 
order. Institutional records should be differentiated from the in- 
formation gathered directly from the clients in the follow-up. 

In planning a follow-up study of drug abuse clients, it is necessary 
to consider the available sources of relevant institutional data in 
order to decide which data sources to employ. Obviously, it 
would not be feasible to collect all relevant, information which such 
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instituticSis possess concerning their past, present and future 
contacts witii the study sample. Therefore, it is necessary to 
categorize theSe institutional sources and to consider what data 
might be sou^t from each in a particular follow-up project. 
After reviewing this chapter, you may decide that seeking uifor- 
mation from outside agencies is worth whatever cost airf difficulty 
may be associated with it. Or you may decide to restrict your 
efforts to particular institutional records. However, to make 
such a decision knowledgeably, you must first familiarize.yourself 
with the kinds of data that might be available and the procedures 
necessary to secure them. 

SOURCES OF AVAILABLE DATA 

Several. general sources of data may be relevant to follow-up 
studies of dicug abuse blients. 

First, there are the records of the treatment program undert^ing 
Qie^^foUow-up study. These records commonly contain ''admission 
information, reports of medical examination and treatment, 
progress notes of counselors and administrative information con- 
cerning various aspects of the client's stay. Ei^esumably all 
follow-up studies will use some of'this information. 



Another source of information about the study population consists 
of records of other institutions — medical, social service, educa- 
tional, law enforcement, alcohol treatment, drug treataient, and 
so on* The usefulness of their records wilt depend upon the ob- 
jectives and intended thoroughness of the foUbw-up study, as well- 
as upon the characteristics of the drug abuse subjects selected. 

A third source of information—often overlooked — consists of pub- 
lished national and regional statistics on drug treatment populiations, 
with which your own study's findings can be conapared. For ex- 
ample, it may be relevant to know about the typical criminality of 
populations of drug abusers nationally, in order to judge whether 
your own program's clients ave an unusual group. So too with re- 
gard to educational attainment, employment: and drug use. In 
addition, it may be valuable to consider how the clients selected 
for study differ'^from the general;population^ ofrdrug^abuffers in 
treatment. Researchers have now delineated not only the general 
characteristics of the 250,000 drug abuse clients in treatment in 
the United States but also the specific characteristics of discrete 
subpopulations of clients. These studies make clear that drug 
abuse clients are not a homogeneous population, and that different 
types of programs serve different clients. A major source of data 
regarding clients in treatment in programs throughout the country 
is maintained by the National Institute on Drug Abuse throug^i the 
Client Oriented Data Acquisition Process (CODAP). Inquiries with 
respect to this file may be directed to the Division of Scientific and 
Program Information at the National Drug Institute on Drug Abuse, 
Some of these data are presented in Volume E of A Manual for 
Drug Treatment Program Self-Evaluation , entitled Table of Values 
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on Selected Treatment Outcome Measures Based On Data From 



the Drug Abuse Reporting Program (DARP) . available from the 
Clearin^ouse, National Institute on Drug Abuse. 



Census and 

bernographic 

Data 



Finally, another potentially important source of information is to 
be found in census data and vital statistics for your local area. 
Knowing the unemployment, crime and mortality rates in the 
follow-up locale makes it possible to compare the study subjects 
with the -general population* Data regarding employment or un-^ 
employment shown by age, sex and race are available for selected 
Standard'Metropolitan Service Areas (SMSAs) through the Bureau 
of Labor Statistics, Department of Labor, 44i G Street, N. W. , 
Washington, D.C. 20001. In addition, aggregated: data on cricae 
are often available from local police forces. Data, regarding 
mortality can be obtained frona local and state offices of vital 
statistics. Descriptions of the population in the communities 
under study by age, sex, marital status, and occupation can be 
obtained from the Bureau of Census for relatively nominal sums. 
Such data are available by census tract and blocks for large urban 
communities. 
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THE VALUE OF INSTITUTIONAL DATA SOURCES 

There are three principal reasoiis:f6r seeking infdraiatio^^ from 
institutional sources in follow-up studies of drug abuse clients: 
(1) to note recent addresses to help in locating clients for inter- 
view; (2) to check the validity of information obtained from prior 
records and interview data; and (3) to obtain additional informa- 
tion about the study subjects. 

Whenever a subject is located in an agency file, any new informa- 
tion in that record about aliases, addresses, relatives or employers 
should be entered and dated on the search sheet. When interviews 
and record data disagree, it is not necessarily ttie case that the 
subject was lying in the follow-up interviews. Records;are often 
simply reports of previous interviews with that..subject in a con- 
text which may have made^him less-likely to be completely candid. 

It is necessary to consider what evidence there is for the accuracy 
of all types of available information. This issue needs emphasis 
because of the inherent limitations of relying exclusively upon any 
one source of information, whefiier interviews^ questionnaires, 
medical records, or other institutional sources. Each of these 
sources nas strengths and weaknesses. Thus, institutional 
records can corroborate or expajid upon the information provided 
through interviews. Conversely, competent interviews can pro- 
vide detailed information not otherwise available. Taken together, 
the institutional records and personal accounts provide more com- 
plete and valid data about follow-up clients than would be detained 
from a single source. 
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Additional 
Information 



The third general reason for using institutional records in foUowr 
lip studies is to. obtain additional information about the subjects, 
such as employment history prior or subsequent to treatment, 
criminality^, schooling, and other experiences the subjects, have 
had with local.institutions» The adequacy of these secondary in- 
stitutional data concerning a particular drug abuser population in 
a given community varies considerably* In all instances project 
personnel will have to take care that the data undei: consideration 
are not only accurate, but also that they have been updated re- 
cently. The adequacy of the data available will dep^end primarily 
upon how old the records are and, how professional the health, 
welfare. and/or police agencies are in the area served by your 
treatrdent program. 



GAINING ACCESS TO INSTITUTIONAL DATA 

In planning to obtain data from institutional sourc93:conceming 
former clients, it is first necessaiy to consider how to approach 
the particular health, welfare, educational, police or ^penal insti- 
tution in a way that will enhance the likelihoai of their cooperation* 
It should not be assumed that these or ottier agencies will autdr 
matically or easily provide outside researchers with confidential 
information. Indeed, the opposite may be the case. Most agencies 
are quite careful about releasing iffibnna^^^ 
dividuals they serve or with who'm they have cpntact^They will 
have both etMcal and legal issues to consider in deciding whether 
to provide the information you want. 



Developing a 
Strategy for 
Cooperation. 



Since it involves gaining the support and cooperation of local offi- 
cials and agency directors, gaining access to institutional data 
requires tact, honesty, and perseverance. If you should decide to 
seek such data, you would be well advised to develop a plan in ad- 
vance for securing the cooperation of those persons in charge of 
the data. 



You might begin by having the head of your agency enter into nego- 
tiations with the head of the agency whose records you need. For 
locally funded programs in particular, it may be useful to rely on 
the good offices of the mayor or city manager to aid in this nego- 
tiation. Once an agreement to cooperate has been obtained, further 
negotiations can then go forward between your research director 
or his agent and the head of the record room in the other agency. 

Principles in You will probably need to give the agency officials a guarantee 

Working with that the information they provide will not be used against them. 

Agency Personnel la any case, you should assure the agency that only tactful and re- 
sponsible staff members will be sent to deal with their agency. It 
is unreasonable to. expect an agency director , to provide you with 
confidential data if he fears that this information may be used by 
you, or others, to discredit him or his agency. Indeed, it may be 
appropriate to indicate that some benefit will accrue to the agency 
that provides you with data. Such a benefit might include written 
recognition in the study report, or providing the agency with those 
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Informal Contacts 



Arrest Data 



research findings that may be useful to its staff. In any case, 
reports produced and data obtained should be made available to 
cooperating agencies. On no account, however, .should the re- 
searcher make or accept an offer to exchange information about 
individual clients in an effort to gain access to institutional 
records,^ nor should any former client be identified as a drug 
abuser to someone who may not know that fact, (See Chapter 5, ) 

To facilitate initial and stdbsequent cooperation, it will be ap- 
propriate if not essential to demonstrate that your study will 
benefit both drug abusers and the conmiunity. However, you 
should recognize throughout that agency officials are, or will 
likely see themselves as, "doing you a favor. " By and large, the 
agency staff will be performing extra work for which they are not 
compensated in order to provide you witti the data. In fact, it 
may be advisable to offer to pay the agency's staff for the extra 
effort required, if you have the funds. 

You should also recognize that not all negotiations between treat- 
ment programs and- agency Bt^f are conducted on a formal level. 
The data gathering staff and the staff at the data source may have 
friends in common who can act as intermediaries by vouching for 
the4reatment*program, -The-treatment-staff-might-consider the- 
possibility of seeking the help of these informal contacts in addi- 
tion to working through the formal system, 

SELECTED SOURCES OF PABTICULAR TYPES OF DATA 

The alternative sources for several specific types of data-will be 
discussed next, as well as some of the issues you should consider 
in securing data from them. 

With regard to arrest data, there are four basic sources: (1) ju- 
venile court records; (2) records at the local police precinct and 
at the central police headquarters; (3) local jail records and cor- 
rectional department records; and (4) court records. Juvenile 
court data are typically difficult to acquire because of Ihe special 
concern with the confidentiality of records of juveniles. Nonethe- 
less, ttiese data constitute a very significant proportion of the 
criminal records of a population as young as are most drug treat- 
ment clients. 

As noted in several earlier chapters in this manual, identifying 
information should be collected at intake into the treatment pro- 
gram that can later be matched up with institutional data, such as 
date of birth, social security number, and all names and aliases 
ever used by the individual. Obviously, care should be taken to 
verify the identity of cases appearing in criminal justice records, 
before assuming they are your clients. In some instances clients 
may already have an identifying number from the court or correc- 
tional agency, as in the case where referral has been made di- 
rectly by one of these agencies. This will make the records search 
easier. 
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Individuals selected to collect the necessary- data should be care- 
fully chosen: they should be non-offenders themselves, they 
should have appropriate concerns about client confidentiality, they 
should dress appropriately and they should act with sufficient re- 
serve. Training in behavior appropriate to data collection at the 
agencies in question should not be neglected. Only tactful and 
responsible-staff members should be used. In addition, the 
p-roject investigators should be concerned at all times about the 
confidentiality of fiieir own client records and names, providing 
an additional reason for careful selection of the individuals 
gathering the data. 

Particular care should be taken with regard to information col- 
lected from jail units. Check to determine whether only felony 
cases are referired to the jail, since the disposition of other cased 
may be made at the police precinct level. Also check to deter- 
mine whether or not the charge recorded is the charge actually 
made against the individual. With criminal justice data, there 
may be considerable delay between the time of an arrest and the 
appearance in the main file of information about the disposition of 
the case. Therefore, a return visit after some months is advisable 
to determine whether new information has appeared. 



Data with regard to school and employment history are apt to be 
limited. In fact, recent federal legislation prohibits schools from 
disclosing the records of their students without the written consent 
of the student (or his parents, if the student is a minor). 

Two additional sources of employment data that at least potentially 
are available to government-sponsored treatment programs con- 
sist of those data maintained by the Social Security Administration 
and the state unemployment compensation offices«„ Social Securitj' 
earmngs records can not be made available for specified clients, 
but will be reported to programs on an aggregate basis only. 

The gathering of material with regard to deaths of former clients 
from the medical examiner's or the coroner's office is usually easy 
to obtain. The program staff should be sure to record the cause 
of-death, since dtiig-related-deaths-are-one^importantmeasure of 
treatment failure. It is also possible to have vital records de- 
partments make searches if you suspect that an individual may 
have died in another community. You must provide not only name 
and birth date, but also year of death, and if possible, the precise 
date. In contacting selected state vital records offices, the treat- 
ment program may make use of Publication No, HSM-72-1142 
(Where to Write for Birth and Death Records) , which is available 
from the Department of Health, Education and V/elfare. 

Other potential sources of information on illicit drug use would 
include the records of hospital emergency rooms, other treat- 
ment agencies, social services agencies and mental health facil- 
ities, T'lese agencies sometimes are extensively used by drug 




abusers, and s^pearance in fhese records, like appearance in 
arrest records, indicates the client is having problems. Health 
and social agencies are, of course, zealous about protecting the 
coafidentiality of these records. Access to them, like access to 
school records, vill require written permission from your sub- 
ject* 
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Next Steps Once you have completed the interviewing and search of relevant 

records, it will be necessary to organize your information for 
presentation in the form of charts, tables, and written summaries. 
The procedures described in this chapter are appropriate for 
smaller programs, where the information .can be haiid-tabulated. 
However, these procedures also have to be performed where the 
sample size is large and where you plan to use tabulating machines 
or a computer. At a minimum, the coding procedures *vill have to 
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; be carried o^jit prior to putting the information onto IBM cards' or 

< \ computer tapes. All the analytical and tabular methods described 

r here can be carried out by computers. However, you must first 

;o. understand what it is you want to do with the information. Com- 

puter technicians are available wherever there are computer fa- 
' , cilities, but such personnel are only helpful when ycu can specify 

what you want. Therefore, it is important to have a clear under- 
K ' standing of the basic methods used to organize data. 

CODING 

In general, respondents are asked the kinds of questions that 
i pear in flie sample interview schedule in Appendix.E. 

|j Simple Data Some data, like sex^ can only be organized reasonably in one 

I: Categories way-male, female. Other data, like age, need to be grouped 

1;. into larger intervals. Otherwise you will have too miany groups 

L to make intelligible tiibles. These simple categories of data are 

f > very useful in any analysis, and this chapter describes how to 

- " make some of the decisions about their use. 

Multidimensional A second class of variables will develop from such interview 
^Variables, questions.as '*What .was. the.title.of your last.jpb? ^* You-inay want. 

to use the elicited information in. several ways. For er^ample, 
you may want to determine what skill level was associated with, 
the job. Or you may be interested in the relative social status or 
I prestige associated with the occupation*. Because these two as- 

pects of employment are not alwayr redundant^ you may not wish 
to limit your data analysis to one d mension. This chapter de- 
I scribes various ways of coding such data to preserve their multi- 

— dimensional significance. , 

Uncoded Data When the interview includes open-euded questions for which you 

have not developed answer categories ahead of tinie, the inter- 
viewer records the response in the client's own words in order to 
discera what might be salient for him/her. Such questions present 
a variety of problems for the analyst and should be avoided if you 
can identify meaningful categories in advance, from v/hich the re- 
spondent'Can be asked to make a-choicei Ways to develop-^ttiese 
categories are suggested in Chapters 2 and 4. Where this is not 
feasible, you will have to review the answers you get after inter- 
viewing is, completed, and sort the ansers into a few code cate- 
gories before they can be used in analysis. This chapter discusses 
some of the principles that can assist you in developing useful 
r schemes for such data. 

: GROUPING CATEGORIES 

When analyzing the interview data, you will observe that some 
I data, such as the respondents* ages, are distributed over a large" 

number of values. The distribution will vary with the type of pro- 
gram and the target population served. For example, you may 
find that in the first ten interviews you examine, the ages are as 
follows: 
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Age 

19, 27, 24, 17, 29, 2b, 21, 21, 22, 19 

The first task is to order this infomation sequentially from low 
to hi^, as in the following illustration: 

17, 19, 19, 21, 21, 22, 24, 27, 28, 29 

It is apparent from the data that several of the respondents are 
the same age. You could group these data into a frequency distri- 
bution as follows: 

Age Frequency 

17 1 

18 0 

19 2 

20 0 

21 2 

22 1 

23 0 

24 1 

25 ^ or - 

26 0 

27 1 

28 1 

29 1 

Your next goal is to find a grouping of the ages which retains suf- 
ficient discrimination so that the grouping does not obscure im- 
portant age-related trends, but which.has enough cases in every 
category to get a stable estimate of the frequency of outcomes for 
respondents in that category. For some kinds of data, there are 
conventional categories, such as five or ten year intervals in the 
case of age data. Using such categories is especially useful if you 
wish to compare your results with those of other programs or 
with census figures. Or suppose that you wish to examine the 
relation between age and employment. You know that younger 
persons have a harder time obtaining jobs. Therefore, you might 
group ages in a way that reflects your experience with job oppor- 
tunities. For example, you might sort out teenagers, younger 
adults, and more mature clients as follows: 

Age Frequency 

17-20 3 
21-24 4 
25-29 3 

This grouping illustrates two principles^ First, the data should 
be grouped into categories that have conceptual importance for the 
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use you plan to make of the information. Second, there should be 
roughly similar numbers of cases in each category. Sometimes 
the first consideration will inhibit the second one, as with a pro- 
gram which has only a few clients who are well advanced in age. 

Of course, the above example has too few cases in each category 
to let you draw reliable conclusions. Subsequent sections of this 
chapter Illustrate methods of data analysis using more realistic 
numbers. 



MULTIDIMENSIONAL CODING 

This refers to the use of the same information in several ways to 
answer different questions. For example, if the interview sched- 
ule asked for the respondent's job title, you mi^t obtain the fol- 
lowing enumeration of categories: 

• cashier 

• machinist 

• plumber's helper 

• clerk in a store 

• bookkeeper 
9 salesman 

• tool maker 

• laborer 

If your interest were in the status implications of the jctos, you 
might classify them into those that are white collar as opposed to 
those that are blue collar: 

White Collar Blue Collar 

® cashier • machinist 

• clerk • plumber's helper 

• bookkeeper o tool maker 

• salesman • laborer 

On the other hand, you may want io focus on the level of skill each 
occupation represents so ttiat you can determine whether clients 
who have acquired higher levels of competence find employment 
more readily upon completion of treatment, irrespective of the 
status implications of their jobs. For such purposes, you might 
classify the jobs as follows: 

Skill I>evel 

• Hi^ Machinist, Plumber's helper. Bookkeeper, 

Toolmaker 

• Medium, Cashier, Salesman 

• Low Clerk, Laborer 
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OPEN-ENDED QUESTIONS 



As discussed previously, wiiere you record responses in the 
clients* own words it is desirable to reduce the responses to a 
small number of categories that still retain most of the meaning 
in tile answers. Developing such categories depends not only on 
the questions you asked, but also on the quality of the responses 
you succe^ed in eliciting. As an example, if the question asked 
the clients what ttiey liked about the program, you ml^t elicit 
the following responses: 

• The program gave me a chance to get my head together, 

^ The chance to talk over my problems with other people who 
have been through the same thing. was the best part of the 
program. 

• I needed to get away from my family so they couldn^t hassle 
me any more. 

• I got a chance to find out that I could do different kinds of 
things as well as the next guy, 

• The way the staff treated me as a person and not just 
another junkie. 

• The job training program was most useful. 

• I liked the educational program because I learned to read 
better. 

To summarize this information in tabular form you need to develop 
a scheme of mutually exclusive categories. The scheme should 
contain a rationale that is helpful in the analysis, in developing 
categories for the responses used as an example above, the pri*- 
mary interest might be in the features of the program that are 
spontaneously reported as helpful. However, some responses 
refer to specific features such as job training, while others are 
much'^more general, such as being able *to get my head*togeUier, " 
That is, some individuals refer to their personal experiences with 
the program, while others allude to particular program attributes 
they found helpful, such as jc* training. If these issues are your 
central concern then you might develop categories along the 
following lines: / 

• Personal Needs: ^ 

• Get head together 

• Get away from my famify 

• Chance to get to do things 
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• P rogram Attributes : 



• Staff 

• Group therapy 

• Individual counseling 

• Job training 
Education 



Broader Coding a more general scheme, applicable to a variety of open-ended 
Categories ^ questions, would distinguish three broad elements of any motiva- 

tion* Thus, the question ''Why did you come into this program? " 
might elicit three distinct types of responses. 

First, some respondents may attribute their entry into the pro- 
gram to various influences such as police or court pressure, or 
family members encouraging the individual to seek help. Second, 
some Piieais may have been primarily motivated by the fact that 
they were in a situation where they could no longer function, or 
felt that they must change. These client needs might include a 
wide range of responses, such as "My veins gave out, " more 
general health considerations, or references to a strongly felt 
need for personal change by the applicant. Finally, some clients 
may mention^things they heard that madejthem.,chQose^ this^pai^i- 
cular program rather than another — for instance, that they Imew 
the program provided methadone for detoxification. 

Subcategories Three aspects of motivation may be identified in these responses: 

(1) environmental influences; (2) client ne^s; and (3) program 
qualities. Within each of these broad categories you can develop 
a variety of subcategories if there are enough respoj^es to justify 
more refined classifications. For example, subcategories undier 
"client needs" might include distinctions among considerations 
such as: (a) health; (b) personal adjustment; and (c) other 
personal needs. 

The precise subcategories will differ among programs combining 
different modalities and drawing on different populations. But such 
a scl?.eme might look something like this: 

EDjVironmental Client , Program 

Intliiences Needs Qualities 



• Family © 

• Friends ® 

• Criminal Justice • 
System • 

• Mass-Media 

• Ex-clients 

• Out reach 



Health • 
Social Adjustment • 
Personal Change • 
Dmg Shortage • 



Location^ 

Residential Program 
Drug-free 

Medical Facilities • 
Skills Training 
Therapy 



For some purposes you might use only the broader categories, but 
where the sample size is large enou^, you may want to tabulate 
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the subcategories^as well. In addition, note that an individual 
may fall into more than one category. As suggested in Appendix 
E, you need to assign a separate column on the punch card for 
each category if this is a possibility. Classifying answers. ac- 
cording to.such a rational scheme reduces the number of re- 
sponses and is also potentially more useful for understanding why 
clients enter treatment. 

These schema are only illustrative. It-may be usefiil to develop 
very different ones, depending on.the way the questions are asked 
and the purposes of the analysis. You should avoid schemes that 
iare too complex, because they will severely limit the ^jrpes of 
analysis which cgn be done. 

Consistency In The classification scheme must also be simple enou^ so- that dif- 

Ppding .ierent coders, whose job it is to classify the-responses, can agree 

on the classification assignments. Their level of agreement can 
be.evaluated.by having two or. more individuals-code-fhe-same-re-~ 
spouses independently. A good rule. of thumb is that;you should 
obtaih.at least 80 per cent concurrence between coders in the, 
classification of responses. A lucid discussion of "accounting 
schemes" can.be found in Zeisel (1968)« 

ORGANIZATION OF THE DATA 

The information necessary for the analysis is likely to come froin 
various sourcesi such as intake records, counselor reports^ 
urine reports, follow-up interviews, police and other records; 
Once the decisions are made on the Information to be included, it 
is important to organize it in a form thatiacilitates easy handling. 

The Data Card The complexity of the data reduction scheme needed will depend 

on the number of subjects and the number of items of information 
per subject. If both are small, it may be sufficient to place all 
the information about one respondent on a single 5" x 8" card, and 
simply count the items on each card by hand. If more subjects-or 
more information per subject is obtained^ it may be necessary to 
employ tabulating equipment, and transfer the information to IBM 
cards. In this case, outside consultation inay be worthwhile. But 
before the information can be placed on IBM cards (or, eventually, 
on computer tapes), it will still be necessary to integrate the in- 
formation in a coherent form, generally on a single document such 
as a "coding sheet, " to facilitate transfer to IBM cards. 

Where a 5" by 8" card or similar document is-used, several things 
should be kept in mind. First, it is hecessary to have an identifl- 
cation^number for each case. This should hot.be the subject's 
name, nor a number which discloses his identity, such as a social 
security number or clinic number, as explained in Chapter 5. 
Second, the same variable should be located in the same place on 
each subject's card or form to facilitate tabulation. Third, the 
exact age or year of birth should be recorded,- rather than reducing 
the information to broad age-ranges on the coding record. It is 



^r.^^ Ill 

ERLC 



123 



better to collapse information during analysis, after you see how 
the frequencies are distributed among catiBgories. 



Layout of the 
Data.Card 



In a follow-up study the general layout of the data card may be 
structured around several basic ai-eas, as illustrated in Figure 1. 



FIGURE 1 

Example Of A Possible Coding System For A 
FoUow-Up Study Of Treatment Clients 
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First, it should include the basic identifying information which 
must appear on every card ~ the study nurnber, card number, and 
case number. Then there are demographic data, such as age, sex, 
and race. A second block might consist of intake variables, such 
as date cf entrance into the program, age of first narcotic use, 
and age of first addiction. The third block might consist of pro- 
gram indicators, such as counselor evaluations, methadone dosage, 
consistency of participation, or number of positive urine reports. 
The fourth block mi^t show the status of the client at the time 
treatment terminated, in terms pf reason ior termination and his 
drug use and adjustment at that time. A final block might consist 
of the follow-up information, such as arrests, einployment, and 
current drug use. 
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^You-may not need alLthe information illustrated in Figure !• How^ 
ever, lit should be noted that the data are roughly organized along 
a time dimension to facilitate, locating the information you may 
need. The information is placed in specified locations. For 
items like sex or status at termination it is only necessary to look 
up the appropriate box. 

Narrative responses should be limited to as few items as possible. 
Both sides of a card can be used so that more information may be 
included. If necessary, each respondent can have two or more 
cards as long as^the case numbers are included so that the cards 
for the same individual can be linked. 

Where information is to be transferred to IBM cards, :Qien the pre- 
cise location that each variable will have on the IBM card should 
also be specified on the unitary form you use to collate oil the 
data._ .(That is,, a card, mimb and column^' jpc^ions will have to 
be specified for each, variable.) It will be- necessary to eliminate 
narrative responses by coding the data before transferring them 
to IBM cards, as described previously. 

PRESENTATION OF THE DATA 

A description of the client population the program is serving is a 
necessary prelude to any study. The kinds, o£clicacs which a pror 
gram attracts can influence alniost every aspect of the program 
and its effects. Therefore, variables describing this clients in 
terms of age, sex, race, education, prior drug use, and arrest 
history should be included. 

It is often convenient to present such data in charts and tables that 
readily communicate the essential information. Charts and tables 
should not burden the reader with excess detail that can obscure 
the essential facts. This chapter f irst reviews tabular layouts 
v/hich show single variables such as age or sex or arrest histories. 
Then graphs are discussed, which are easier to grasp than large 
arrays of numbers. 

TABLES 

You may want to present in tabular form the age distribution of the 
clients who fall into your study group. If it is a program that tends 
to serve mainly younger clients, you may discover that most of 
the ages range between 15 and 34, with only a few somewhat older. 

After listing the ages in sequence you might find it more convenient 
to group them into five-year intervals as follows: 



,10.3 125 



AGE DISTRIBUTION OF CLIENTS IN PROGRAM XYZ 



Age 


No. 




17 


20-24 


18 


25-29 


19 


30-34 


12 


35+ 


3 




69 



From the distribution of the frequencies you observe that the num- 
ber of clients by five-year groups is reasonably constant from 
ages 15 to 29, and declia^s thereafter- There are so few people 
over 35 that this is an open-ended category where every^resppndent 
over 35 is grouped together, irrespective of the exact age. 

Presentations of raw frequencies, as in the table above, make it 
hard to draw comparisons between programs or between one 
period and another for the same program. Percentage distribu- 
tions allow comparisons when the number of cases differ in the 
groups being compared. 

The table above presented as percentages would look as follows: 

AGE DISTRIBUTION OF CLIENTS lOTROGRAM XYZ 
ON PER CENTS) 



Age • 


Per Cent 


15-19 


25 


20-24 


26 


25-29 


28 


30-34 


17 


35+ 


4 




100 




059) 



Because of the modest sample size in this example, percentages 
have been rounded to whole numbers to avoid a spurious sense of 
precision and to simplify the table for the reader^ It should be 
noted that the total number of subjects appears in parentheses be- 
low the 100 per cent total, to allow the reader to evaluate the 
stability of the percentages^ The larger the number of cases, the 
more stable the percentages^ For example, if there are only ten 
cases, changing a single case from one category to another changes 
th^ two affected categories by 10 percentage points each. On the 
other hand. If there are 300 cases, changing a single observation 
would add or subtract only three-tenths of one per cent. 
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Some researchers prefer to present two columns: onecolunm 
containing the actual frequencies, as in the first table, and 
another containing he percentages, as in the second table. How- 
ever, when tables contain two or more variables, this practice 
creates very cluttered tables* In any case it is unnecessary, 
since the reader can reconstruct the frequencies by multiplying 
the total number of cases by each percentage listed in the table* 

Each table must have a title that informs the reader what infor- 
mation is contained in the body of the table, dolumn headings 
must be clearly identified* You should avoid abbreviations that 
detract from communicating the nature of the information con- 
tained in the table, 

GRAPHS 

It has been noted previously that a long seiies of numbers com- 
municates-little information to-individuais-who^are^not-familiar-^ ^ 
with research. However, even experienced individuals can often 
ieam a great deal from a gr^hic display of data/ 

The following bar graph presents information op, the frequency of 
arrests in the sample. The horizontal or X-axis displays the num- 
ber of arrests in the past 12 monthsi - This is jhiB variable that is 
of centr^al interest* The vertical or Y-axis displays the number-^-^ 
of clients who had that number of arrests. Frequencies (or per- 
centages) are always located on the vertical axis. 



Client Arrest Histories for 12 Months 
Preceding Intake in Program XYZ ' 



Frequency 


30 




28 




26 




24 




22 




20 




18 




16 




14 




12 






10 




8 




6 




4 




2 




0 
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From this graph it may be observed that only a few (12 per cent) 
oif the clients have had no arrests in the 12 months prior to enter- 
ing treatment. The most tojqiient (or modal ) number of arrests 
in that year is one, and as the number of arrests increases, the 
number of clients sharply declines. All of this information can 
also be displayed in a corresponding table. However, the trends 
may be more discernible when presented in graphical form. 

On the Y-axis the actual frequencies can be found by simply look-^ 
ing across from each cbser\'ation to the appropriate point on the 
scale. Unless the scale on the vertical axis is large, only ap- 
proximations to the exact frequency can be read off. But this lack 
of complete precision is less important, iu most cases, than the 
addition such graphs make to communication. It is sometimes 
useful to substitute percentages for the frequencies, particularly 
if samples of different sizes are being compared. 

The histogram or bargraph is primarily useful for an ofdered 
series, but it can also be used to-present data where it cannot be 
^^assumed that one category is 'higher" or "lower" than another on 
some scale. For example, histograms should be used to com- 
pare numbers by sex, ethnicity, or type of drug history. 

SOME DESCRIPTIVE STATISTICS 

Whenever there is an array of numbers — whether an age distri- 
bution, number of months employed, or number of arrests — it is 
often useful to sunmiarize these by a single number that reflects 
the overall experience of the group. Descriptive statistics are 
simply some convenient procedures for summarizing data. These 
are basically simple concepts. However, erroneous conclusions 
may be drawn if some of the factors that influence them are not 
understood. Therefore, this chapter reviews some of the basic 
assumptions behind these statistics. 

The mean — or average — is widely used and understood, and it 
is therefore particularly valuable. It should only be computed on 
ordinary nuinbers — which in- principle can include a zero^ and 
for which a '*two" is twice the size of a "one. " Such numbers 
would represent counts of missed appointments, dollars earned, or 
milligrams of methadone prescribed. Where ratings are used it is 
technically incorrect to use the average, because you do not know 
that a rating of "3" meaning "much improved" is three times the 
size of a "1" meaning "no change. " However, this rule is fre- 
quently violated even by experienced researchers. The mean can- 
not be used at all to describe variables that have no inherent order, 
such as ethnic classification, types of criminal charges, or sex. 

If you have a series of ages of clients in the program and want to 
compute the mean, you simply total all the ages and divide by the 
number of subjects. If you have the same age distribution you had 
in the first section of this chapter, you would find the total ~ 227 — 
and divide by 10, the number of cases. The mean would be 22, 7 
years of age. 
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The formula for the operations just performed is: 



Computing tffe 
Mean of Frequency 
Distributions 



n4 



Limitations 
of the Mean 
with Asymmetrical 
Series 



The Median 



2X 

M = -rj-, where M = Mean ^ 
2 = Sum 

N = Number of cases 

X = The individual's value.on the variable 
in question (e.g; , his age) 

Sometimes the symbol X is used, instead of M, to stand for the 
meap.. 

Often, however, your data are in a frequency distribution, rather 
than in an array of single numbers, as illustrated in the first sec- 
tion of this chapter. In such a case, the formula is modified 
subtly to facilitate calculations: 

„ ^ -S'f X^ 

M = ""j^i where f = frequency 

If you look back at the previous frequency distribution you will 
notice that there are two cases at, age 19 and two at 21, The 
symbol "f" simply reminds you that you have to multiply each 
particular age ~ such as. 19 — by the appropriate frequency, 
which in this case is two. The resultant answer is exactly the 
same as in the first formula^ 

If your data are hi a frequency distribution with intervals that are 
more than a single integer, as where the ages are grouped into 
four-year intervals, it will be necess/iry to let the X in the formula 
stand for the mid-point for each interval into which ages are 
grouped. This leads to small inaccuj^acies which you will not have 
if you code exact ages. 

The mean or average ~ is generally the best way to summarize 
a large series of numbers. It also has other statistical properties 
which make it even more valuable. However, it is hot, a good in- 
dicator of what is 'typical" when the series' of observations is 
markedly asymmetrical. This could happen if your program's 
clients consisted mostly of teenagers and young adults, with only 
a few persons of more advanced age. These few individuals can 
raise the mean considerably. Suppose all the females in your pro- 
gram were between 17 and 24, and that most of your males were 
also in this age range. However, if you happened to have a few 
males in their 30s, a mean would exaggerate the age differences 
between the sexes in your sample. When you have a few extreme 
cases, another cescriptlve statistic ~ the median ~ is more 
appropriate. 

The median is simply the value of the middle case in your ordered 
series of numbers. It can also be used for "oider statistics'^ such 
as ratings, where you are not certain of the precise interval 
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between adjoining numbers. Suppose you had the following num- 
bers (let them be the same series examined previously): 

17, 19, 19, 21, 21, 22, 24, 27, 28, 29 

The '^middle'' number-in this series falls between 21 and 22, In 
this case you would locate the number halfway between these two 
numbers and designate the median as 21, 5, Where there is an 
odd number-in the series you would be able to select. the.middle. - 
case as the median without having to extrapolate. The same 
principle is involved if the data are in a frequency distribution, 
although the estimation of the particular value becomes a little 
more complicated. If this becomes necessary, you should con- 
sult a statistics text. 

The advantage of the median is that it is not influenced by extreme 
deviations. In distributions where the cases are scattered 
symmetrically above and below the median, the^two^indices — -the^ 
mean and the median — will be identical. 

Rates Another convenient way to summarize results is called a rate. 

This is applicable to those variables where neither means nor 
medians are ^propriate. A rate — of \^^ich a percentage is one 
example — is simply a fraction or ratio. It represents the num- 
ber of times an event-occurs (being male, dropping out of the 
program), divided by the total relevant population, -Because the 
denominator, the relevant population, will be larger than the 
numerator, the resulting figure is less than one, so that a decimal 
point would precede the ratie. 

Using a Constant To avoid decimalization, the results are multiplied by a constant. 
Multiplier k. When k is 100, you have a percentage. However, if you, are 

examining relatively rare events where the numerator is small, 
you may choose a k equal to 1,000 or any other convenient number. 
Death and crime rates are often reported as rates per 100,000, 
There should noc be any confusion as long as flie choice of k is 
made clear to the reader. The formula is as follows: 

f 

Rate =~ k, where f = the subgroup of interest 

P p = the relevant total population 

k = constant 

Rates are easy to calculate and very useful. For example, in your 
follow-up, you could calculate the rate of employment at 12 months 
after discharge. However, you might also want to know not only 
how many are employed at this moment, but also the proportion 
of the time since terminating treatment that the average client has 
been employed. 

In this case, the numerator (f) becomes the total numJDer of months 
worked since discharge by all fhe clients in your follow-up sample. 
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Rates Reflecting 
Group Performance 



and the denominator (p) becomes the total number of months since 
discharge added up for all clients. If all respondents had the 
same length of time out — for example, 12 months ~ then p 
would be 12 times the number of individuals in your study. 

The computation of both group and individual rates of employment 
over the interval since discharge is illustrated b^low. Individual 
rates would be useful if you plan correlational analysis, to show 
the degree of relationship between employment and some other 
variable, such as education, ;\^ere you also have a score for 
each individual. 



Client 

A 
B 
C 
D 

E 

Total 



No. Months Since 
Termination (p) 

9 

17 
14 
11 

23 

74 



No. Months 
E^mployed ffl 

8 
12 
14 

2 
16 

52 



Individual . f 
Rate ^ p 

.888 . 

. 706. „ 

i.oob 

.182 

.696 

3.472 



Rate I = 3. 472/5 = 0. 6944 = . 69 or 69% 
Rate n = 52/74 = . 702 = . 70 or 70% 

These data show for each client the number of months since termi- 
nation and the number of months employed. It is usually sufficient 
to round off both numbers- to the nearest whole monfli. However, 
more exact representation would not alter the procedure for find- 
ing a group rate outlined above. 

The last column presents the ratio of number of months employed 
to the number of months since leaving the program, giving a rate 
for each individual. One method of obtaining a raio foi: the entire 
group is to find the sum of the individual rates and divide by the 
number of individuals who entered into the calculations, in this 
case five, as illustrated by Rate I. However i you may have no 
particular interest in individual rates if the information v/dl not 
be used for further analysis. The group rate can then be obtained 
by a second method — simply dividing the number of months em- 
ployed, 52, by flie total number of months flie sample has been 
terminated, 74. Rate 11 shows this procedure. If a few individuals 
had many more months since discharge than the rest, this second 
method allows the group's rate to be inordinately influenced bv 
them. ^ 

Rate I treats each case as a single unit. Thus, respondent A with 
only nine months since termination has the sme influence on the 
group rate as respondent E with 23 months. In "the example given, 
the differences between the two methods are negligible. These 
two methods of obtaining a rate will usually yield very similar 
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results unless there are very large differences among individuals 
in tiie number of months since termination. 



VARIABILITY 

In addition to measuring central tendency by calculating means, 
medians, and group rates, it is often useful to examine the distri-^ 
bution.of the data across all icdivlduals, or to compare the way it 
varies across groups. For exianple, it mi^t be useful to com- 
pare-the retention of male and female clients. The following graph 
presents a hypothetical set of data comparing the time of termi- 
nation of male and female clients in a particular program* Bo- 
cause mere are usually many more males than females in drug 
programs, the vertical or Yraxis is stated in terms of percentages 
rather than frequencies, to facilitate comparison. 



Percentage Terminated Montiily 
for Mate end Female Clients 

Per Cent Terminated 




No. Months Treatment 



The graph shows that both groups have varying lengths of time in 
treatment, but the males have a much more '"modal" or typical 
pattern (of approximately 12 months of treatment) than do the 
females. Using only one index — the mean ~ would have obscured 
this difference, since the mean for men and romen would both be 
about 12 months. 

The Standard When a graph is not used, it is possible to compute a variability 

Deviation index to sunmiarize the shape the graph would have. This index 

is called the standard deviation. 
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Calculating the The formula is: 
Standard Deviation 



1 N-l 



where s = standard deviation 

X = each particular observation 
M = mean 
2 = sum 

N = number of cases- 

To calculate the standard deviation, the mean is first subtracted 
from each observation. Where there is more dispersion there 
will be larger differences between the mean and the scores. The 
numbers thus obtained, as seen in the illustration below, are 
squared. Then the sum of the squared numbers is divided by the 
total number of observations minus one. (This subtraction is 
necessary for reasons too technical to ejqjlore here.): Finally, 
the square root of the number thatJs generatedJs-calculated.-- 

The calculations may be illustrated with the series of age data 
used in the previous section on file median as follows: 



Calculation of Mean (M) and Standard Deviation (s) 



X 


(X-M) 


(X-M>^ 


17 


-5.7 


32.49 


19 


-3.7 


13.69 


19 


-3.7 


13.69 


21 


-1.7 


2.89 


21 


-1.7 


2. 89 


22 


-0.7 


0.49 


24 


1.3 


i.69 


27 


4.3 


18.49 


28 


5.3 


■ 28.09 


?9 


6.3 


39.69 



2.X=227 2(X-M)=0 2(X-M)^=154.10 



_ 2X 227 • „ 



s 



_ J2(X-M)^ _^ /1500 
y N-l ~1 10-1' 



= ^17. 12 = 4.14 

N = 10 



The resulting standard deviation, 4.14, is an index of variability. 

It is useful to examine the standard deviation whenever it is sus- 
pected that variability is very different among the groups being 
compared. As noted previously, two groups may have the same 
mean yet very different standard deviations. Giving both the mean 
and the standard deviation completely describes any nbrmallv 
distributed variable. 

The standard deviation has other important properties when data 
are distributed in a normal curve aiid it serves as the basic 
statistic for many important tests used to determine statistical 
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significance. A review of these properties of the standard devia- 
tion jan be found in any statistics text. 
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The previous chapter described several methods for 
organizing and presenting some of the descriptive Informa- 
tion collected In a follow-up study. However, you generally 
want to know something about the relationships between 
pairs of measures (variables). These relationships may 
concern changes over time In the same variable - such as 
employment status on entering treatment and one year 
afterward. Or you may be Interested in relationships 
between different variables - such as^between the reasons 
for entering treatment and retention In the program. 



THE DATA FOR ANALYSIS 

Generally, you will have Information-only on, the treated 
group and on those clients who withdrew or were discharged. 
This markedly Influences the conclusions you are^ able to 
draw. It makes It difficult to infer that the treatment 
accounts for any changes that may be noted. Improvement, 
for instance, could be Influenced by many things other than 
the treatment regimen. Only a comparison group of similar 
Individuals who have not been In treatment would permit a 
clear Inference that Improvement means the program has 
been effective. On the other hand, if there has been no 
Improvement, It Is generally safe to say that the program 
Is ineffective - unless there is reason to believe people 
could become worse without treatment. 



Typ?s of Data 



However, important comparisons can be made even without 
an vmtreated or control group. Comparing the experiences 
and reactions of those who remain in treatment with the 
experiences, of those who withdrew can help staff to innovate 
more successful program strategies. And you can learn 
what kinds of clients do and do not achieve program goals. 

If you used the data collection procedures illustrated In 
Chapter 4, you will have collected data that reflect client 
status at three significant time points: before treatment, 
during treatment, and after treatment. The possibilities 
for combining and comparing information representing 
these different time periods are almost unlimited, but this 
chapter suggests a few comparisons in which you may be 
particularly Interested. This chapter illustrates.ho^y to 
construct tables for the purpose of examining relationships, 
though it is also possible to answer many of the same ques- 
tions. using other techniques. 



Correlating Intake and 
Outcome Data 



How to 
Cross-Tabulate 
the Data 



INTAKE-OUTCOME TABLES 

No-^matter how well a program may select cliexits or manage 
its program, different clients will respond to the program 
differently. There are always those who decide to leav^ the 
program before staff thinks they should, and thop'^-^h.oso 
behavior prompts the staff to discharge them. Those 
individuals who successfully complete treatment can be 
compared to those who entered with them but withdrew or 
were terminated. 

Suppose you want to know whether the reasou f'^^ ^omlng 
into the program has any bearing on how the client responds 
to treatm.ent. To answer this question, you will have to 
exarJiine reasons for entry simultaneously with information 
about which individuals complete the treatment cycle, 
("Completion** will be defined according to how the program 
defines its treatment regimen, X Comparisons are made by 
cross -tabulating the information on these two types of data 
for each individual in the program. 

If carrying out the cross-tabulation by hand, you would first 
sort all cases into a few broad categories of reasons for 
entering the program. You would then sort cich of these 
piles into those who completed treatment and those v;ho 
terminated, and coimt the resulting piles. Where tabulating 
equipment is used, it carries out essentially the same pro- 
cedure for you. The results might look like the following: 
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Reasons for Entering Program and Treatment Status 



Treatment 
Status 



Reasons for Entering Treatment 

Environmental Client 
Influences Needs 



Program 
Qualities 

[ 50%.].* 
[ 50% ] 



Completed 
Terminated 



35% 
65% 



63% 
37% 



100% 
(23) 



100% 
(40) 



100% 
(10) 



*Brackets Indicate the percentages are based on 
only 10 caseSe 

This table makes clear that those clients who acknowledged 
some personal need are most likely to remain.in the pro- 
gram. Where other persons or agencies Influenced clients 
to enter the program, the proportion who completed the 
cycle appears to be substantially less, although certainly 
not negligible. Because-the^third^^rea'sbn, program qualities , 
was so rarely given, its effect cannot be studied. Note that 
its column in the table is bracketed-to show the number ' 
provides too small abase for -reliable percentages. This is 
a problem encountered frequently with smalLsamples. ' 

How do you establish wfiich variables are independent and 
which dependent? The general rule is that something, prior 
in time, such as reasons for entering treatment, is the 
putative "independent" variable. "Reasons" are an independ- 
ent variable and "remaining In treatment" is dependent, 
because reasons for entering treatment can influence 
whether a person remains in treatment or leaves It, but 
the reverse is improbable. When the variables might occur 
in ei'wher order, the decision as to which to treat as inde- 
pendent or dependent is more a niatter of your assumptions 
about the direction of causality. 

The categories of the independent variable are usually 
located on the'' horizontal axis, a'^ column headings, while 
the dependent variable is usually located on the vertical 
axis, as row labels. Percentages are then based on column 
totals. This conventional approach can be violated where 
other considerations arise. The most common reason for 
reversing their position is that the independent variable 
may be divided into too many categories, to fit across the 
page. However, the reader must always know in which 
direction the percentages are computed and the number of 
cases on which percentages are based. This is done by 
including the totals (lOO^per cent) either at the bottom of the 
columns as in the previous table,, or at the right olthe.rows 
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when the independent variable is placed vertically, and by 
putting the nmnber of cases in parentheses next to the 100 
per cent or next to the category name. 

Many independent variables might influence a particular 
dependent variable. Among factors that you might consider 
are sex of the client, age, education, socioeconomic level, 
ethnic background, age at onset of drug use, whether there 
has been previous treatment, duration of addiction, criminal 
history and work experience. Each of these can be treated 
in-a manner parallel-to the way^ HReasons^or ^Entering: 
Treatment" was used abovev, tovsee:;wh^^^ appears 
to be a relationship between any of these and any dependent 
variable such as the completion of treatment. 

Many dependent variables can also be studied — referring 
not only to the treatment experience but also to adjustment 
after treatme. t ends. One common dependent variable is 
staff's rating of improvement. For outpatient programs, 
regularity of attendance and percentage of urines positive 
for morphine may be useful. After treatment, self-reported 
drug use, airrests, and employment status. may have interest. 
Any aspect of the program or life afterwards for which 
regular and consistent data have been collected can be an 
appropriate candidate for a dependent variable, so long as 
clients differ with respect to it. Choosing the particular 
variables to use will depend on the nature of the program, 
the areas that the staff view as problematic, and the 
importance of that aspect of the program. 

MULTIVARIATE TABLES 

Once you look at the many independent variables that may 
influence your dependent variables in bivariate tables (i. e. , 
tables with one independent and one dependent variable), 
you are likely to discover that several independent^variables 
were associated with a particular dependent variable. For 
example, you may find that employment rates are higher 
for males than females, for older clients than younger ones, 
for those who have more education, and for those who had a 
later age of onset of drug use, A full discussion of all the 
possible ways to proceed if you discover this to be true is 
beyond the scope of this manual. However, one option often 
brings clarity to the possibly confusing array of significant 
patterns that have been identified. 

The first thing to^do Is to determine how the independent 
'variables that you found related to your dependent variable 
are related to each other. For instance, you may note that 
older clients had a later age of onset of drug use than 
younger clients. The analytical problem, then, is to attempt 
to decide whether both chronological age of the client and 
age of onset are really important in predicting employment. 
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Or is only one making a difference? Only when both 
independent variables are examined simultaneously with the 
dependent variable can some insight be gained into which of 
these alternatives is correct. 

Each respiondent must now be classified simultaneously in 
three ways: by his chronological age, his age of onset, 
and whether he was employed at foUowrup. Becaiise you 
are substantially increasing the number of ca:tegofies to be 
examined, it is often necessary to reduce the number of 
categories in each- variable. How'much collapsing df 
categories you have to do will depend on your sample size, 
the way the variables are distributed in your particulai: 
program, and the degree of the correlation or association 
between the variables. In the folloWing<tables, note that 
chronological age is dichotomized,/wMle ap of ohset is 
grouped into three categories. You:try to collapse the data 
so that you have reasonable numbers Ofccases fii each 
category while losing as little inforiiaation as pdssible. 



Employment Status One Year After Treatment 
By Current Age and Age at First Addietion 



Current Age 



Employment 
Status 


Age 21-30 


Age 31 and Over 


Age of 
Addiction Onset 


Age of 
Addiction Onset 


Under 
18 18-24 25 + 


Under 
18 18-24 35 + 


Unemployed 

Part-time 
employment 

Full-time 
employment 


38% 28% 20% 
43% 44% 25% 
19% 28% 55% 


42% 29% 18% 
42% 40% 24% 
16% 31% 58% 



100% 100% 100% 100% 100% 100% 
(42) (76) (20) (31) (52) (50) 



This table has been constructed to make it possible to 
examine the relationship between age at onset of drug use 
and employment status separately for different age groups, 
and the effect of age groups separately for those with differ- 
ent ages of onset. This is what is meant by "controlling" on 
a variable —that is, holding one variable relatively constant 
while looking at the relationships between two other variables 
The table shows for both age groups that the later the age of 
onset of addiction, the larger the proportion who are employed 



full-time at follow-up. Conversely, comparison of selected 
columns from each t)anel with the same age of onset ~ such 
as those clients whose addiction occurred prior to their 
eighteenth birthday — shows there is verj' little difference in 
employment by current age. Similar observations can be 
made for each pair of age-of-onset columns. 

The table^'shows, thon, that the significant factor relative 
to employment is age of onset, not current age. The only 
reason current age was originally found to relate to employ- 
ment was that -clients who -are now older .became.addi cted 
later in life. 

K results had turned out differently, it might be concluded 
that the relationship between .lat.e onset and holding a job 
occurs only among older clients, that both factors influence 
employment, or that only current age has an important 
influence on employment. More details on this procedure 
may be found in Zeisel (1957) and in Rosenberg (1968). 

EVALUATING PROGRAM OUTCOMES 

The "pay dirt" for a follow-up study is to be able to find out 
whether those who have been treated have improved in 
significant areas of functioning. You may have obtained 
follow-up information on employment, income, family 
status, arrest records, self -reports on illegal behavior, 
self -reports on drug use, even urine analyses on the 
respondents at follow-up. The significant question ~ one that 
turns out to be much more difficult than it may seem — is 
whether there is a discernible increase in approved types 
of behavior or any decrease in those types of behavior that 
are considered deviant. 

Factors other than treatment may be accounting for observed 
"improvements" or "declines, " but you cannot tell whether 
this is so unless a comparison group is used. For example, 
if the labor market changes drastically, employment may be 
influenced positively or negatively irrespective of the quality 
of your employment training efforts. Similarly, changes in 
police enforcement policies might account for observed 
changes in arrest levels, rather than some real change in 
the criminal behavior of the clients. Only a "control" group 
can obviate alternative explanations for changes through 
time, and this is rarely available. Nevertheless, many 
useful things can be learned by foUowrups if these limitations ~ 
are kept in mind. 

One important limitation is that in the period from intake to 
termination you have lost many of your clients. In some 
programs most cliciits will not complete the treatment 
cycle. The overall trends of apparent improvement are 
often primarily a result of a process observed in all 
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programs; namely, that those who withdraw or are termi- 
nated are, on the whole, more resistant to program efforts, 
and were generally more deviant to start with. Thus, at 
follow-up those who stay on have less crime, more employ- 
ment, better family relations, and less drug.abuse than 
those who leave, but this is not necessarily. because they 
got more treatment. To avoid confusing differences in the 
,<inds of. clients who finish with effects ofrthe program, you 
should take the following precautions: (1) contrast , survi- 
vors with terminators as of the time they entered.treatment, 
so you at least know how they differ beforehand; and (2) 
examine cohorts who entered together durinjj the same time 
period and who completed treatment , then any changes you- 
observe cannot be due to the changing con^osition of. the 
group'under study or to historical bhanges in job opportuni* 
ties or police practices. 

One potentially important outcome of treatment might be the 
employment status of clients who complete the prescribed' 
course of treatment. Since clients who were workihg^when 
they entered treatment will tend to continue. to work, possible 
good effects of treatment on employment are probably limited 
to those not working at intake. 

The foUowii^ table shows how to report, on the employ- 
ment outcome of clients in a hypothetical program, taking 
work history before entry into account. 

The table does not simply report that 50 per cent of the 
follow-up clients were employed at foUowrup. Instead clients 
are first sorted according to their employment status at 
intake. Since this precedes subsequent employment, it is 
the independent variable and is located on the horizontal axis. 
Then on the vertical axis you tabulate the employment status ' 
at follow-up, which is the dependent variable. Since you 
may have cases who were not located or who gave no answers 
you must account for these in your table. Usually, they ' 
should not be included In the base on which percentages are 
calculated. In the following table they are accounted for In 
a footnote. As In the previous sections the percentages are 
based on the sub-categories of the independent variable, 
employment at intalce. 
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Employment Status at Intake and One Year 
After Completion of Treatment In Program XYZ 



Employment 


Employment Status at Intake 




One Year After 
Treatment 


juj xup ioycu 




Total 


Employed (104) 


88% 


34% 


50% 


Unemployed (102) 


12% 


66% 


50% 


Total: (206)* 


100% 
(64)* 
31% 


100% 
(142)* 
69% 


100% 



♦Missing cases include 2 employed and 3 unemployed 
who refused to be interviewed. 



Overall the table shows that 31 per cent of the clients who 
completed treatment had been employed at intake (64/206). 
At follow-up, this figure increased to 50 per cent (104/206). 
The table also shows that almost all of those who were 
employed at intake report employment later (88 per cent), 
while of those who were unemployed at intake, only about 
one -third (34 per cent) are gainfully employed after treat- 
ment. In other words, the slight loss of employment among 
those who were initially employed was more than compensated 
for by the employment of clients who were initially imemployed. 

However, it cannot be safely concluded from this table that 
it was the program that improved the employment status of 
the group completing treatment. Other factors like matura- 
tion or an improvement in local economic conditions may 
have caused it. If a non-treatment comparison group failed 
to show a coinparable increase in employment, then these 
alternative explanations might be ruled out. However, even 
without a comparison group, these findings may suggest that 
perhaps greater efforts in job training and placement should 
be directed toward those unemployed at intake. With all the 
constraints referred to in the design chapter, it appears that 
the status of the group may have been improved in the 
employment area as a result of treatment, but it should also 
be noted that there remains room for improvement. 

The considerations illustrated in this section bear on efforts 
to show the effect of treatment on any outcome variable. The 
same procedures apply, and similar tables may be con- 
structed, if the outcome variable has several categories 
instead of just two, or if rates calculated on the base of 
1,000 or 10,000 were used instead of percentages. However, 
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some important questions about criterion measures that 
arise in many follow-up studies have been skipped over. 
Some of these will be considered more fully in the next * 
section. 

• MEASURING PROGRAM INDICATORS 

It was noted earlier that some collapsing of categories is ' 
necessary in .analysis to avoid small groups. This collapsing 
Is vital for the .Independent variables,, but Is.not so.ueces- 
sary for dependent variables, because they can be presented 
In both large and small categories In the same'table. Too 
much collapsing losas essential information. In the 'previous 
table, for instance, employed could have been divided into:- 

Employment Status at Intake 

Employment One Year 

After. Treatment Employed Unemployed 

Employed 88% 34% 

Employed less 
than 6 months 12% 26% 

Employed more 
than 6 months 76% 8% 

This would have shown that not only are few clients who 
were unemployed at Intake now employed, but even thqse 
now employed bav© been unemployed most of the time since 
leaving treatment. It has been assumed that all clients 
have had the same length of time since treatment. 

•^■■"a Use In some earlier follow-up studies, drug use since discharge 

was often collapsed into "ever" and "never. " The "ever" 
category combined clients who had used drugs a single time 
with those who were using drugs daily, on the supposition 
that even very occasional use would lead inevitably to com- 
pulsive use. Such a method tends to exaggerate the "failure" 
rate unduly: it Is now clear that many occasIonaLusers do 
not necessarily move on to compulsive use, even if formerly 
addicted. It Is best to subdivide the "ever" group into those 
who report occasional use, regular usa but not daily, and 
daily users. Generally It Is also necessary to do this for 
each type of drug separately, although you may also want to 
group all Individuals who use any of the addictive drugs into 
one index, especially where your program deals with mixed 
addictions. Since some individuals may abandon the drugs 
that brought them to treatment and become dependent instead 
on alcohol, you may want to add heavy alcohol users to the 
clients viewed as having returned to drugs. 
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It is not proper to assume that anythbg less than regular 
use after treatment is evidence of program success. First, 
there may be imder-reporting. Second, without an untreated 
control group it is not possible to draw the conclusion that 
diminished c&ug use is due to program participation, since 
otiier forces-, such as aging, are also at work. Self- 
reported drug use, however,,, can be used to compare 
various sub-groups, such as the following: (1) those who 
completed the treatment cycle in contrast to those who 
failed to do so; (2) individuals who were exposed to dlffer- 
ent.treatment,modallties.;. .and.(3),.dlfferent .ethnic J, sex or 
age groupings of clients. In this way it is possible to learn 
what kind of clients need special.help. 

Aside from the problem of accuracy of employment reports, 
the major problem is how to cope with individuals for whom 
emplo3rment may not be a viable goal* This includes 
individuals who are unemployable because of physical or 
mental infirmities, women with: children who choose fo be 
homemakers, full-time: students and those engaged in 
various forms of vocational training. One solution is to 
exclude the handicapped froni the calculation, as was done 
with missing cases in tie previous example, and then 
define homemaklng, schooling, training, and working as 
all socially useful and aggregate them either in the form of 
a rate or a classification, on the assumption that all are 
equally valid options. Of course, the resulting classification 
Is no longer simply employment .but is better Identified as 
'^productive activity" or "socially useful activity. " When 
this is done, the number of categories in the dependent 
variable should be expanded to specify: unemployed, full- 
time employment, part-time employment {e.g. , less than 
20 hours a week), homemaker, student, vocational training, 
unemployable. Or, where the sample is too small for such 
refinement, the categories can be limited to employed, 
imemployed, and other socially useful occupation, with an 
explanation of what groups went Into the "other" category. 

Where comparisons are made between pre-program and 
post-treatment arrest histories, it Is important to use the 
same sources v ^formation for both, so that self -reports 
are not being compared v;lth police records. It Is also 
desirable to have the pre-program Index of criminal activity 
cover a several-ye^r period in order to avoid inflating the 
level of prior criminal activity of clients. Since arrests 
are often the occasion for entering treatment, clients 
generally experience high arrest rates just preceding entry 
into treatment. It is questionable whether this unusual period 
should be compared with the period following treatment. 
Second, it is necessary to adjust for the fact that different 
clie>.\ts will have different lengths of time Involved. Those 
who enter treatment young will have had fewer years In which 
to get arrested. The procedure described In Chapter 9 for 




calculating individual employment rates can be used to 
construct individual arrest rates, which are then averaged. 
This equalizes the effects of different lengths of time among 
clients. 

A second useful consideration, especially for maintenance 
programs, is to distinguish those charges directly related 
to drug use from those related to money-raising and other 
types of criminal activity. JLprogram may obtain a spurious 
sense of accomplishment concerning crime reduction when 
drug arrests have dec l while oth er forms of crimin al _ 
activity remain undiminished, or even increase. 

Criminality tends to decline with age, and wonien and 
middle-class clients commit fewer crimes than others. 
Where a program serves a mixed age, sex, or socioeconomic 
group, it is often helpful to separate cli:^nts by age.group, 
sex and other categories that reflect your particular client 
population when looking at posttreatment criminal activity. 

STATISTICAL SIGNIFICANCE 

The issue of statistical significance is a complex one. This 
section discusses the issues that should be considered^when 
dealing with stat^'stical significance ana reviews one "model" 
that iis appropriuce for the form of analysis described in this 
manual. 

Researchers are often interested in making the statement 
that the results observed in a particular tfiile illustrate a 
true relationship. For example, a previous table showed 
that clients who enter treatment because of "Influences" 
terminated 65 per cent of the time, while those who canae 
because of "Client Needs" terminated only 37 per cent of the 
time. The question is whether this pattern within the table 
reveals a relationship which is unlikely to have occurred 
in ttiis sample simply by chance. 

It is useful to understand just what is meant by "chance. " 
For example, if you throw a pair of dice, there are 36 
possible ways they can come down (each of the six faces of 
the first die combines with six faces of the second). Only 
six of these 36 give a score of seven. Asstmiing a perfectly 
balanced pair of dice, this means that the probability of 
getting a seven is one in six, or 17 per cent of the time. 
But if you tossed the pair of dice only ten times you might 
well find that you never got a seven at all (0 per cent), or 
you might get three sevens (30 per cent), neither very close 
to 17 per cent. However, if you tossed the dice 100 times 
the chances are that you would get sevens close to 17 per 
cent of the time. If you had the patience to toss the dice 
10,000 times, you would very likely get something very 
close to 17 per cent of the tosses turning up as seven. 
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What does this mean about. interpretlngJindings of follow-up 
studies? Where there are relatively iew observations, then 
the "observed" values may scatter widely around the true 
value in the population from which the sample was drawn. 
Under the same conditions, the larger the sample of obser- 
vations, the better your estimate of the true population 
value is likely to be. When two or .more values are com- 
pared, both may deviate from .the true population value, 
possibly widely if there are few cases or just a little if 
there are many cases. Unreliably large differences may 
appear — that is, the observation of one variable may deviate, 
in one direction, while observation of the second variable 
deviates in the opposite direction. Of course, there is.-also 
the reverse possibility, where differences appear more 
modest than they realiy are. It is precisely to tal^e these 
random effects into account that statistical tests become 
important when drawing conclusions. 

Statistical tests are simply ways in which knuwledige about 
the size of the group being studied and the Inherent variability 
of the data can be exploited to assign a probability that what 
you have observed could have happened by chance. The 
objective is to reduce the likelihood of asserting that a dif- 
ference exists when in fact there is a reasonable probability 
that there is no true difference at all, and that the observed 
difference occurred only by chance. It is conventional to 
reduce this risk of error to five per cent or less, sometimes 
only one per cent, depending i!pon your judgment as to the 
consequences of asserting a difference when In fact you 
might be wrong. (See Chapter 3. ) Most research analysts 
in progranmiatic research are satisfied with a five per cent 
level of significance. 

Of course, even after testing for statistical significance, 
you will occasionally be wrong when you say a difference 
exists. If, for example, you achieve the five per cent level 
of significance, then you will be wrong about five per cent 
the time when you conclude there is a* difference. The best 
way to reduce your imcex*tainty Is by repeating the research. 
When successive replications continue to yield significant 
results, the risk of being wrong becomes very small {, 05 x 
. 05 = . 0025 or . 25 per cent instead of 5 per cent). 

To assess the significance of difference, the most common 
statistical test Is the chi-squared (x^) test for contingency 
tables. The chl-squared test makes no assumptions about 
the kinds of measurements you h^ve. It Is appropriate for 
variables having only nominal classifications, like ethnic 
classification or sex. It can also be used for ranked vari- 
ables like socioeconomic status for variables with true 
absolute values, like age, although other tests that assunie 
order or a true number scale might find significant results 
you will miss with chl-squared analysis. Different kinds of 




measures may be used in the same analysis. The chi- 
squared test compares your actual results (those you 
observe in your table) with the way the frequencies would 
have distributed themselves if the relationship had been 
produced by chance. 

To illustrate the underlying logic of x^, a simple problem 
will be examined. When actually performing the calcula- 
tions, there are more rapid methods that are rreviewed in 
most standard texts. The objective here is only to illustrate 
the logic of hypothesis testing and, more partlcuiarly, the^ 
test. 

Suppose you suspected that female clients were more likely 
than males to have. completed the:treatment cycle in your 
program. The next table shows in the left panel the fre- 
quencies for terminated and retained clients by sex. Note 
that these are the actual numbers of clients and not per- 
centages, because nimibors are what you need for the x^ 
test. 



Observed and Expected Frequencies for 
Sex Differences in Completion of Treatment 





OBSERVED 




EXPECTED 




Male 


Female 




Male Female 


Terminated 


60 


20 


80 


57. 12 22. 88 


Completed 


90 


40 


130 


92. 88 37. 12 


Totals 


150 


60 


210 


150 60 



The same procedure can be carried out for each of the four 
cells. 

The table shows that 40 out of 60 women completed treatment 
(67 per cent), compared to 90 out of 150 men (60 per cent). 
This is a seven per cent difference. The question is whether 
a difference as small as that is significant, i, e. , whether 
women do complete treatment more often than men, or 
whether this is simply within the range of differences 
likely to occur by chance. 

In order to estimate how the cases would distribute them- 
selves if sex and completion of treatment were completely 
independent, the matrix on the right side of the table has 
been constructed. It is based on the same principle as the 
previous calculation that the probability of getting.a seven 
on a single throw of the dice is , 17. It follows that if the 
probability of a single throw coming up seven is . 17, the 
probability of getting two sevens in succession is (. 17) x 
(, 17) = , 0289, or about three per cent. You are actually 
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exploiting a basic law of probability theory which asserts 
that if two events are independent of each other, t^n the 
probability that they will occur jointly is the product of the * 
probabilities of each event taken separately. In this example, 
probability of being male is 150 out of a total of 210 clients, or 
. 714. The probability of being terminated Is 80 out of 210, 
which equals , 380. The product of . 714 and . 380 Is . 272. 
That Is, If a client's probability of leaving treatment were 
independent of his/her sex, you would expect slightly over 
27 per cent pf all the cases tQ fall In the .cell that intersects 
being male and terminated, or the top left cell In the table 
on the right panel. Taking 27 per cent of 210 cases, you 
get an expected number of 57. 12, #That is, if there was no 
relationship between sex and termination there would be 
only about 57 Individuals in the upper left comer of the table. 
The right panel, then, shows how you would expect the 
cases to be distributed if sex and cojnpletlon of treatment 
were Independent of each other. 

The Calculation What you have to do now Is to assess the Importance that 

Qf ^2 can be attached to the differences between the observed and 

expected values in corresponding cells in the two panels of 

the table. The formula for doing so Is: 



Where: O = Observed frequencies 
E = Expected frequencies 

The formula simply Informs you that for each cell you must 
subtract the corresponding expected values from the 
observed ones, square the value thu£ obtained, and divide 
it by the expected value. After doii^ this separately for 
each cell, you simply add up the obtained values, as Indi- 
cated by the symbol 2 In the formula. Their sum Is defined 
as the chl-square value. 

It Is usually easier to carry out these Instructions with the 
layout Illustrated In the following: 



Calculation Format for Chi-Squared 
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(1) 


(2) 


(3) 


(4) 


(5) 


Observed 


Expected 


(0-E) 


(0-E)2 


(0-E)2/£ 


60 


57. 12 


2. 88 


8.29 


. 145 


20 


22. 88 


-2. 88 


8. 29 


.362 


90 


92.88 


-2. 88 


8.29 


.083 


40 


37. 12 


2. 88 


8.29 


.223 
2 = .819=x2 



Note that columns (3) and (4) all have the same number. 
This is a fact peculiar to 2 x 2 tables and would not be 
true for larger tables. 

With contingency tables, the number of cells in a table 
influences the likelihood of random variability: the larger 
« the.humber of cells, the greater opportunity there is for 

random effects. Therefore, the interpretation of has to 
be tempered by this fact, and this is identified as "degrees 
of freedom. " In contingency tables ,. the degrees direedom 
are the number of rows minus one (r-1), multiplied by the 
number of columns minus one (c-1). In the above example 
there were two rows and two columns, and therefore (2-1) x 
(2-1) = 1. (This is merely another way of saying that if 
you. know the totals and the value of one cell in a 2x2 table, 
you can calculate the other three cells. That is why the 
values in column 4 are identical. ) 

Testing the Statistical in almost every statistics text there is a table of x-^. Only 

Significance of x2 a portion of such a table is given below. 

Selected Values of x 2 

Degrees 
of 



Freedom 


P= 20 


P=.10 


P=.05 


P=.01 


1 


1.642 


2.706 


3. 841 


6.635 


2 


3.219 


4. 605 


5.991 


9.210 


3 


4.642 


6.251 


7.815 


11. 341 



Note that in the first column are degrees of freedom and that 
in the column headings are various probability levels. Within 
the table are the x^ values that correspond to these probability 
levels. Note that for increasing degrees of freedom the 
values of x2 also increase for the identical probability 
levels, reflecting the phenomenon of more "random" 
effects as the number of categories increases. In each row, 
however, you can observe that as the values increase, the 
chance probability level declines: the higher the value of 
X^, the less the probability that differences observed were 
found by chance. 

For the problem, just calculated, it is apparent that the 
value obtained, x = .819, is not as large as any value in 
the appropriate row for one degree of freedom. Thus, it is 
necessary to conclude that the differences found between the 
sexes could well have occurred by chance. 
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If the value here had been at least as large, or larger, 
than 3. 841, and if . 05 had been chosen as an acceptable 
significance level, the conclusion would be that women are 
less likely to terminate. 

The chi-squared test is only one of a great variety of pos- 
sible ways of testing the significance of differences. A 
very large difference will be fovmd significant by any test. 
You may want to ask for statistical consultation to decide 
how muchxredence to. give to smaller differences. But you 
should not become a ^lave to significance testing and the 
magic of a . 05 significance level. Important differerces 
may exist but not show statistical significance because you 
have a small sample. On the other hand, if your sample 
is very large, a small and imimportant difference will be^ 
statistically significant even though it will be of no practical 
use. In the loi^ run, it is not the statistical significance 
of ftjL particular test, but whether your findings set an imder- 
standable pattern and survive replication \xx other samples, 
that determines whether your research has made ^pof taht 
discoveries. 
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The final stage in your research study will be to write a report — 
summarizing the nature of the project, documenting the results, 
and spelling out what, if any, implications the results have for the 
administration of your program. Without a well-presented report, 
all the preceding efforts will be of limited valu3, because the 
project will not be in a form whereby others can xeview it aul 
profit from its findings. 

POTENTIAL AUDIENCES FOR THE REPORT 

What you write about the study and hew you write it are likely to 
be influenced by the type of readership you are assuming. Three 
of the more likely audiences for your report are discussed here. 

Treatment Certainly the director and staff of the program itself will have an 

Staff interest in the report and should receive copies. Presumj^bly 

some or all will have taken a hand in conducting the study and 
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perhaps also in writing the report. Nevertheless,, it would be 
desirable for all of them to read the completed document and to 
benefit from whatever information and insights it may contain. In 
fact, it would be. advisable to schedule a staff meeting to. discuss 
the report, debate th-^ validity of its conclusioniB, and-consider 
its implications for the program. If the report is to be sent to 
outsiders, it may even be advisable to hold such a meeting before 
the final draft is completed so that insights gained at the meeting 
can be incorporated. 

Tf your follow-up study was conducted at the request of a sponsor- 
ing or funding agency, you may have no choice concerning whether 
or not to provide them with the report. On the other hand, if your 
study was self -initiated, you will have to decide whether distri- 
buting it to outside agencies is a desirable step. The fact that 
your program has been involved in systematic self-examination 
and is attempting to improve its procedures is likely to be seen 
as a plus. 

If sponsoring agencies will receive the report, you probably will 
be particularly concerned about the quality of the writing, the 
rigor of the analysis and the description, and the overall ap- 
pearance of the document. Also, if it is important to demonstrate 
program impact, you may decide to devote -a more substantial 
proportion of your analysis and writing to that subject. 

It may be desirable to prepare your report for collateral agencies, 
such as those agencies who refer cases to you and to whom you 
refer cases for additional help. These might include legal aid or 
health and social agencies. In addition, you may want to i^end 
your report to individuals on city councils or state legislatures who 
have shown particular concern about drug abuse and who may be 
considerinjc legislation related to it. 

In general, results of follow-up studies" are be'st lised^at a practical 
level, within the program itself, as a guide for the director and 
staff. Studies of single programs are not likely to produce find- 
ings which could be published in the professional literature, though 
some will. If yours is such a study, a separate article may be 
written for a particular journal using its required format and 
conventions. The article should not be written in lieu of a more 
comprehensive report, but rather should be based on some par- 
ticular subset of the findings which will be of interest to a larger 
audience and which can be captured in a fairly brief article^ 

ORGANIZATION OF THE REPORT 

Regardless to which of these audiences you address your report, 
it is likely that you will want to follow about the same general out- 
line in writing it. While there obviously is no one "ri^t way" to 
organize such a report, the totncs outlined here should probably 
all be included in one form or another. Presentation in the follow- 
ing sequence should work well, unless you have some unusual re- 
quirements. 
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It is generally helpful to have a short statement at the beginning, 
of .the report which gives an overview of thb study and notes any 
major findings. A one or two page abstract should be sufficient 
in most cases. If there are important consumers who are un- 
likely to read the full report — funding agendy executives, for 
example — you may want to devote a few pages to an "executive 
summary" at the beginning. This summary will ordinarily follow 
the same outline as the whole report, but contain only a one or 
two sentence highlight from each section. It is useful to include 
page references for each^heading to facilitate loc^^ 
detailed information in the main report. Although it is ordinarily 
placed in front of the report, the executive summary is the last 
section to be written. 

Statement of A good opening for the body of the. report is a statement of the 

Obiectiyes purposes for which the follow-up study was launched. These need 

not be,belabored at great length,, but it helps the reader a^ s/he 
proceeds through the remainder of the report. to have in mind the 
research questions which are being addressed. If your objectives 
shifted during^ the course of the study it inay;b6-useful to note how 
and why they were revised. 

STUDY DESIGN AND IMPLEMENTATION skcTION; 

The purpose of this section of your report is to document the way 
you v/ent about designing and conducting the. study. This section 
should be written in enough detail to allow independent judgments 
about whether the design was sound aid whether the procedures 
were likely to lead to any systematic biases in ttie results. The 
reader does not need to know every name and number which passed 
throu^ the process, but rather needs to understand the nature of 
the procedures and how they worked. 

This brief section should indicate who had overall responsibility 
for the direction of the-project and (if they*are'^different)'*who'had^ 
major responsibility for the various stages such as ^'nterviewing 
and analysis. The role that those individuals normally play in the 
ordinary functioning of the agency should also be noted. 



; Abstract or 
ExecutWe Summary 



Staffing 
Responsibilities 



Study Design The nature of the specific study design you chose to follow should 

be stated clearly, as well as your rationale for choosing it. A 
review of Chapter 3 might be useful in considering what points to 
include in this section. 



You should first make clear who was eligible for selection into the 
treatment group and the control or comparison group, and if pos- 
sible how many eligible cases there were for each. Then you 
should indicate the method by which you selected a sample from 
those eligible, and how many cases you selected. 

Data Collection In this section it is helpful to list the data you tried to obtain with 
Procedures resnect to each subject and how you went about getting it. This 

will*molude a description of the records you used and of the 



Sampling 
Procedures 
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dnformation you selected from them, as well as the methods used: 
(a) to locate respondents, (b) to set up interviews with them, and 
(c) to actually conduct the interviews. 



This is also a gopd.place to describe how the interviewers were 
chosen and trained, and to indicate some of the characteristics of 
the interviewing staff. For example, you might want to describe 
their cpmpositionin terms of sex, age,^ race, previous drug 
history, mi counselor status. If counselors v/ere used, you 
should indiicate whether or notnhey interviewed their own former 
clientsi Or, if interviewers were matched with clients in any 
other systematic manner, that also should be noted. 

Since the interpretation of the results will and should be influ- 
enced-by the adequacy of the .obtained samples, it is very importaat 
to indicate what proportion (percentage) of each target group was 
finally located and what proportion (percentage) was actually in- 
terviewed. It is helpful to give these figures for important sub- 
samples such as dropouts or older whites, so that the reader can 
judge how seriously to take your conclusions with respect to these 
sub-samples. If some sub-groups have been especially difficult 
to locate, those located may not be a representative sample of 
that sub-group, even when location rates for the_sample as a 
whole are quite high. 

It is advisable to mentipn any serious problems you may have 
encountered while conducting ihe study, so that tiie reader can 
have them in mind while digesting the results. It is also sug,,3Sted 
that you indicate what, if any, impact the problems may have had 
on the final results. If you think there was any substantial Impact, 
you will probably want to return to the topic again in your discus- 
sion of the results. 

ANALYSES AND RESULTS SEGTION- 

Exactly what subsections should be included in your discussion of 
the analyses (and the results to emerge from them) will depend on 
the type of research design you use and the major research ques- 
tions you are trying to address. The several types of objectives of 
follow-up studies outlined in Chapter 1 suggest some sections you 
may want to consider, and are the basis for several of the sub- 
sections suggested below. 

A good starting point for the section describing your program is to 
present some descriptive statistics on the client sample studied. 
Most of tLese data will have been gathered at intake. 

It may also be useful to compare your sample with national or local 
statistics on the composition of other programs. Variables such 
as sex, age, ethnicity^ drug history^ and reasons for entering 
can be clearly displayed—probably in table3--to give some notion 
about the variety of client groups ser^/ed by the program. 




(h. 



Program Completion 
and' Associated 
Factors 



Service 
Delivery 



Client. Reactions 
to the Program 



Comparable descriptive information on any other control or com- 
parison f roups you have studied can be given in the same tables 
and/ or la separate tables. Not only will that permit an examina- 
iion of those who failed to start or complete treatment, but it can 
also facilitate an examination of the retention rates for clients 
having various characteristics. 

Insofar as you have included questions in your interviews con- 
cerning the quantity and types of various services received in the 
program, you may find-that the nature-of the services^ actually 
received by clients differed from what you intended. You may 
also want to show some descriptive tables' for'the whole sample 
and perhaps for some specific subgroups such as age or sex 
groups as well. 

Again, if you have mcluded questions about how the clients see the 
program or feel about it, you will probably wantito display the 
results in tables or graphs. Also, you may want to consider com- _ 
paring different types of clients to^ see if they have (or had) different 
views. 



Experiences and 
Behaviors After 
Treatment 



Group 

Comparisons in 
Outcome 



Whether or not you have comparison or c6ntroI;groups, you will 
at least want to display as much iiifbrmation ais you can on the 
natural history of your clients after they leave the program. This 
certainly should be done for the entire client sample and probably 
for important subgroups as well. 

Following the procedures outlined in Chapters 9 and 10, you also 
should present comparable data for whatever comparison or control 
groups you had in your research design,, first emphasizing the 
natural history rattier than attempting to explain what caused it. 

Finally, you will have the more difficult task of trying to see what, 
if any, effect your treatment (or variations in treatment) had on 
the clients. Since the appropriate analysis inettiodp are dfscussed 
at length in the preceding chapter, they will not be repeated here. 
However, it is probably worth mentioning once more that any 
interpretation of causality is likely to be quite tentative. Initial 
differences in the groups being compared should be taken into 
account to the fullest extent possible, and even after trying to take 
initial differences into account, there may remain some unidenti- 
fied and unspecified differences between groups which help to ex- 
plain differences in outcome. 



DISCUSSION AND CONCLUSIONS SECTION 

Presumably you will be discussing the nature of the findings and 
some of your interpretations of them as you write the analysis and 
results section. But you may want to develop a more general dis- 
cussion of the entire project and its results. Be sure to include 
what you think the results mean ard some notion of how confident 
you feel about them. 
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This is also an appropriate place to summarize the various results 
vlujh.have been discussed piecemeal in the previous section and, 
perhaps, to give some indication of their relative importance, 

IMPLICATIONS FOR CHANGES IN THE PROGRAM 

It is important to consider explicitly whether the results of the 
study have any implications for changing your program and, if so,- 
what they are. There is a particular advantage' to trying to^ 
.committhese.ideas.to.paper because you then will be forced to be 
more explicit about the logic* In addition, all interested parties 
will then have the same description in mind of what is being pro- 
posed, and why. 

It may turn out that your study dia ot produce as clear a message 
as you might have wished about what changes would be advisable. 
But you should not feel that because a study does not produce a clear 
mandate for change that it was not worth doing. You will probably 
be much better informed about the likely benefits and costs of any 
change. Use your own judgment and that of the treatment staff 
about the importance and reliability of the findings and what they 
mean in deciding whether any changes should result. Letting staff 
and other interested persons review a draft of the report before 
writing its final section on implications for change may help to 
produce ideas that can then be incorporated into the final section. 
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APPENDIX A 



CHOOSING THE UNIT OF ANALYSIS 



The;unit of analysis Is the thing or person which serves as the focus of the study, the 
subject or subjects on which the data are to be gathered. 

For the puriwses of this manual it is assumed that the unit of analysis in most studies 
will be persons who have received drug treatment. This is by far the most conven- 
tional unit of analysis for the follow-up of drug treatment clients. However, it is not 
the only .unit of analysis which could be considered. 

Some researchers would argue that the effects a treatment program has on the broader 
community noy be as important in the long run as ito direct impact on the clients 
themselves. iBut it is generally not possible to study a program's effect :on clients 
and on the community at the same time using the same research design. The clients 
and the community are entirely different units of analysis, and quite different types of 
studies are required to measure a program's impact on them. A couple of examples 
may illustrate the point. 

The Crime Reduction Goal 

One goal of most treatment programs is to reduce "drug-related" crime. That is, In 
addition to the goal of reducing client act ivity in the crimes of possesslng.or selling 
drugs, most programs also wish to reduce the general levels of such non-drug crimes 
as theft and prostitution, which are presumably Increased by the presence of drug 
abusers in the cominunlty. In taking drug abusers off the street and Involving them 
successfully in treatment, most programs have the collateral aim of lowering overall 
non^drug crime rates in their communities. 

However, Involving drug abusers in treatment may have little Impact on commimlty 
crime rates !^ the relationship between drug use and non-drug crime Is weak or non- 
existent, as-some Investigators have suggested (Silverman &-Spruill, In press; Gouldi 
1974). On the other hand, It Is also possible that a program may be unsuccessful In 
curbing drug abuse but successful In lowering crime rates. For example, methadone 
dispensed at a clinic may lower the demand for (and thus the price of) heroin being sold 
on the streets. In any case, success or failure with clients does not necessarily 
correlate with success In lowering overall community crime rates. 

This example shows that the choice of one particular imlt of analysis rather than 
another will restrict what can be said about the impact of a program. If the question 
Is whether treatment lowers crime rates among clients, then clients are the appropriate 
unit of analysis. On the other hand. If the quest} ^ is whether a drug treatment pro- 
gram has had an impact on overall conmiunity ci .e rates, then overall conmiunlty 
crime rates are the appropriate unit of analysis, ,-ssesslng a program^s Impact on 
these different units of analysis would require two quite distinct types of studies, 
employing different designs, measurements, and analyses. This Is why Isolating the 
unit of analysis at the outset Is essential. 
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the "Decriminalization'' Goal 

Another type of research question might also imply imits of analysis other than clients. 
'An example would be a study which seeks to learn whether a treatment program helps 
to "decriminalize** drug use. Sitnply staled, many treatment program personnel 
would argue that irrespective of whether or not they can ''cure" drug abuse, it is a 
positive accomplishment if they can convince the community that drug, abusers are ill, 
and t^Xerefore in need of treatment, rather than immoral, and thus in need of punish- 

To study decriminalization, units of analysis other than clients of the program would 
be needed. These might include, among others, dispositions of drug cases by the 
coiurts, accounts of the "drug problem" appearing in various commimications media, 
or opinions held by the public. If causal links between changes in these various 
"indexes" of decriminalization and the presence of a drug treatment program in the 
community could be found, it could be argued that a certain kind of program "success " 
had been demonstrated. 



REFERENCES 

Gould, L. C. Crime and the Addict: Beyond Common S'^nse. Drugs and the Criminal 
Justice System . Edited by J. A.Inciardi; andC.D. Chambers. Beverly Hills: 
Sage Publications, 1974, pp. 54-75. 

Silverman, L. P. , and Spruill, N. L. Urban crime and the price of heroin. Journal 
of Urban Economics , in press. 



ERLC 



^146 158 



APPENDIX B 



TABLE OF RANDOM NUMBERS 



10 09 73 25 33 76 52 01 35 86 34 67 35 48 76 80 95 90 91 17 

37 54 20 48 05 64 89 47 42 96 24 80 52 40 37 20 63 61 04 02 " 

.08 42 26 89 53 19 '^4^ 50 93 03 23 20 90 25 60 15 95 33 47 64 

99" 01 90 25' 29 09 37 67 07 15 38 31 13 11 65 88 67 67 43 97 

12 80 79 99 70 80 15 73 61 47 64 03 23 66 53 98 95 11 G8 77 

39« 29 27 49 45 66 06 57 47 17 34 07 27 68 50 36 69 73 61 70 

00 82 29 16 65 31 06 01 08 05 45 57 18 24 06 ' 35 30 34 26 14 

35 08 03 36 06 85 26 97 76 02 02 05 16 56 92 68 66 57 48 18 

04 43 62 76 59 63 57 33 21 35 05 32 54 70 48 90 55 35 75 48 

12 17 17 68 33 73 79 64 57 53 03 52 96 47 78 35 80 83 42 82 

65 81 33 98 85 11 19 92 91 70 98 52 01 77 67 14 90 56 86 07 

86 79 90 74 39 '23 40 30 97 32 11 80 50 54 31 39 80 82 77 32 

73 05 38 52 47 18 62 38 85 79 83 45 29 96 34 06 28 89 80 83 

28 46 82 87 09 83 49 12 56 24 88 68 54 02 00 86 50 75 84 01 

60 93 52 03 44 35 27 38 84 35 99 59 46 73 48 87 51 76 49 69 



22 10..94 -05^ 58 60 97 09 34 33 50 50 07 39 98 65. 48 11 76 74 

50 72 56 82 48 29 40 52 42 01 52 77 56 78 51 80 'l2 43 56 35 

13 -74" 67- 00 78 18 47 54 06 10 68 71 17 78 17 74 35 09 98 17 

36 76 66 79 51 90 36 47 64 93 29 60 91 10 62 69^91-62 68 03 
91 82 60 89 28 93 78 56 13 68 23 47 83 41 13 09 89 32 05 05 

17 46 85 09 50 58 04 77 69 74 73 03 95 71 86 40 21 81 65 44 

17 72 70 80 15 45 31 82 23 74 21 11 57 82 53 14 38 55 37 63 

77 40 27 72 14 43 23 60 02 10 45 52 16 42 37 '96 28 60 26- 55 

66 25 -22 91 48 36 93 68- 72 03- 76 62 11 39 90 94 40 05 64- 18- 

14 22 56 85 14 46 42 75 67 88 96 29 77 88 22 54 38 21 45 98 

91 49 91 45 23 68 47 92 76 86 46 16 28 35 54 94 75 08 99 23 

80 33 69 45 98 26 94 03 68 58 70 29 73 41 35 53 14 03 33 40 

44 10 48 19 49 85 15 74 79 54 32 97 93 65 75 57 60 04 08 81 

12 55 07 37 42 11 10 00 20 40 12 86 07 46 97 96 64 48 94 39 

63 60 64 93 29 16 50 53 44 84 40 21 95 25 63 43 65 17 70 82 

37 08 92 00 48 61 19 69 04 46 26 45 74 77 74 51 92 43 37 29 
42 05 08 23 41 15 47 44 52 66 95 27 07 99 53 59 36 78 38 48 
22 22 20 64 13 94 55 72 85. 73 67 S9 75 43 87 54 62 24 44 31 
28 70 72 58 15 42 48 11 62. 97 34 40 87 21 16 86 84 87 67 
07 20 73 17 90 23 52 37 83 17 73 20 88 98 37 68 93 59 14 16 



This table is reproduced with permission from tables of the Rand Corporation. 
Reprinted from Edwin B. Cox, ed. , Basic Tables in Busines s and Economics * 
New York: McGraw-Hill, 1967. ~ * 
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APPENDIX C 



SAMPLE SIZES REQUIRED TO SHOW SIGNIFICANCE AT 
THE 95 PER CENT LEVEL (ONE-TAILED TEST) IN 
DIFFERENCES IN PROPORTIONS IN GROUPS OF EQUAL SIZE* 



Po 


p- a 05% 


10% 


15% 


20% 


25% 


30% 


35% 


40% 


45% 


10% 


418 




















84 


lyb 


791 












- 


30« 


4Z 


an 
0/ 


ion 

120 




iUD4 










40% 


11 


37 


53 


83 


145 


319 


1237 






50% 


19 


24 


31 


42 


60 


92 


159 


344 


1311 


60% 


14. 


17 


21 


27 


34 


45 


63 


95 


162 


70% 


11 


13 


15 


18 


22 


27 


35 


^5** 


1 62 


80% 


9 


10 


11 


13 


16 


18 


22 


27 


33 


90% 


7 


8 


9 


10 


11 


13 


15 


17 


20 



Note: p- = the proportion or percentage of a group having a particular 
characteristic. 

=the comparable proportion observed in. another group, (p- 
should be assigned to the group having the higher proportion. ) 



* Adapted'from Table A-3, Joseph L. Fleiss, Statistical Methods for Rates 
and Proportions . New York: Wiley Merscience, 1973. 

** The circle is only applicable to the example In Chapter 3 and is not to be 
used for any other computation. 
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APPENDIX D 



ESTIMATING PERCENTAGE DIFFERENCES 
BETWEEN PROPORTIONS 



Upper and lower bounds may be calculated on the true difference between two rates 
from two populations, given an obse^^ved difference between two samples from those 
respective populations. For example, li you have a group-therapy sample which 
yields a 70 per cent success rate and an individual theraj^y sample which yields only 
d 40 per cent success rate, you have obviously observed a ^substantial. difference in 
success. However, before making too much of the 30 per cent difference you may want 
to kpow how much confiderce you can have that the size of that difference can be 
extrapolated to others \/ho might go through your program. The following formula can 
be used to determine the upper and lower bounds of an interval within which you can 
guess the true population difference lies, and only expect to be wrong five per cent of 
the time. This is also called 'the 95 per cent confidence interval. "* 



FORMULA 



upper limit: (p^ -p^) + 



P2 (I-P2) 



lower limit: 



(Pl-P2> - 



P2 (l-Pg) 



In the example used above, p^ is 70 per cent, pg is 40 per cent and (p^ -pg) is 30 per 
cent. If the number of cases in the group-therapy sample (N^) was 50 and the number 
of cases in individual treatment (Ng) was 100, then the upper and lower limits of the 
difference in the portion of successes can be estimated as follows: 



EXAMPLE 



upper limit: 



= (.70-.40) + l.S6 V^^^ ^ ^^^^ 
= . 30 + 1. 96 ^'.0042 + .0024 



^ These formulae yield a confidence level of 95 per cent. If a 90 per cent confidence 
interval were to be calculated, the constant term l. 96 in each formula would be re- 
placed by the value 1. 65. If an 80 per cent confidence level were judged acceptable 
the term would be 1. 28. ' * 

<d 149 i 6' / 

ERIC 



upper limit (continued): 

= . 30 + . 159 
= .459 or 45.9% 

lower limit: 

.(Note.that.alUcomputations are the same as. for the 
^ upper limit, except that the second parenthetical 
term is subtracted from — rather than added to — 
the first term of (p^^ '•P2)* 

= .30-. 159 

= . 141 or 14. 1% 

As a result of these calculations, we can state with 95 per cent certainty that the true 
difference in success rates lies between 14. 1 per cent and 45. 9 per cent. (As you can 
see from the formulae, increasing the sample size reduces the range of uncertainty. ) 

To take another, perhaps more realistic example, if we had observed '^success rates'* 
^hich were only 10 per cent apart (50 per cent versus 40 per cent) , the lower and 
tipper confidence limits would come out to be -6. 9 per cent and 26. 9 per cent. Note 
that, although group therapy was observed to have a higher success rate by ten per- 
centage points, we cannot be certain (with 95 per cent confidence) that, in fact, group 
therapy is better. That is, our confidence interval (True p for group therapy- 
True p for individual therapy) includes a negative value, -6. 9 per cent — ^which would 
mean that individual therapy might just have a better success rate, by as much as 6. 9 
per cent, if data from the entire population of clients were gathered. 
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APPENDIX E 



INTERVIEW ITEMS 



On the following pages are some sample questions. The great majority of them have 
actually been used in survey studies. Nevertheless, the admonition In Chapter 4 about 
the need for careful pretesting still applies. The Items are grouped, as in Chapter 4, 
into Independent, Dependent, and Other Variables. In the left colunrn Is a brief 
phrase, indicating what the question Is Intended to measure. Many of the questions 
may not need to be asked at a follow-up lntervle\/ if the answers were obtained in a 
baseline interview. An asterisk (*) Indicates such an Ite.n. 

If there are areas of interest to you which are not adequately covered, you can make 
up your own questions (and very carefully pretest them). Or, preferably, you may 
make use of two volumes published=by-the National Institute on Drug Abuse: 

"Research Monograph Series 2: Operational Definitions in Socio- 
Behavioral Drug Use Research 1975. Edited by Jack Ellnson and David 
Nurco 

"Research Issues 12: Drug Abuse Instrument Handbook. " Edited by 
Alexis Nehemkls, Mary A. Macarl, and Dan J. Lettlerl 



INDEPENDENT VARIABLES 

DEMOGRAPHIC 

Sex* (BY OBSERVATION) 

(1) Male 

(2) Female 

Date of birth* What is your birth date? 



(month, day, year) 

Ethnic origin* (LY OBSERVATION) or, What Is your race or ethnic background? 



(1) 


White (not of Hispanic origin) 




(2) 


Black (not of Hispanic origin) 




(3) 


American Indian 




(4) 


Alaskan native (Aleut, Eskimo Indian) 


(5) 


Asian or Pacific Islander 




(6) 


H ispanic -Mex ic an 




(7) 


Hispanic-Puerto Rican 




(8) 


Hispanic-Cuban 




(9) 


Other-Hispanic 




(10) 


Other (Specified: 


) 



Place of birth* Where were you bom? 

(city, state, country) 
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Education What is the highest grade of school, or year of college you 

completed? 



GRADES OF SCHOOL 

2o|ioSioliI0^g6l@®g9l|iol|nlli 





COLLEGE 


13 


m 15 17 + 



What is the highest degree or diploma you have received? 
(1) None 

Regular hie^ school 
General Ei*u.cation Degree (GED) 
Associate Degree 
Bachelor Degree 
Post-Bachelor College Degree 
Other (Specify: ) 



(2) 
(3) 
(4) 
(5) 
(6) 
(7) 



Age Left 
School 



How old were you when you left school the first time for one year 
or longer? 



AGE IN YEARS 



FAMILY BACKGROUND 



Father's 
Education* 



Mother's 
Education* 



What is the highest level of schoolxag that your father completed? 

(1) Grade school or less 

(2) Some high school 

(3) Completed high school (or equivalent) 

(4) Some college 

(5) Completed college 

(6) Graduate or professional school after college 

(7) Other (Specify: ) 

(8) DonH know or does not apply 

What is the highest level of schooling that your mother completed? 

(1) Grade school or less 

(2) Some high school 

(3) Completed high school (or equivalent) 

(4) Some college 

(5) Completed college 

(6) Graduate or professional school after college 

(7) Other (Specify: ) 

(8) Don?t know or does not apply 



ERLC 



152 



164 



What type of wprk did your father do mostly during the time when 
you were growing up? 



(RECORD VERBATIM) 



(CODE FROM LIST BELOW) 

Executives"and\heads of large companies ^ 
Major professionals (doctor, lawyer, CPA)j' 

Man^ers-and^heads^of smaller businesses 

or or^nizations 
Other professionals (registered nurse (RN) , 

ceritf led social worker (MSW), teacher,, 

accoimtant) 



Administrative personnel (store manager) 
Owner of snaall businesses 
Professional artists (sculptor, musician) 

Clerical and sales, workers (baiflc teller, 

booldceeper, stenographer, sales clerk, 

shipping clerk) 
Technicians (dental technician, draftsman) 
Self-employed or shop owner (newsstand, 

tailor shop) 
Para-professlonals (trained counselor, 

other social worker) 

Skilled manual workers (chef or head cook, 
licensed vocational nurse (LVN of LPN), 
electrician, machinist, painter, welder) 

Semi-skilled workers (short order cook, 
hospital aide, apprentice, bus driver ^ 
guard, machine operator, taxi driver, 
waitress) 

Unskilled workers (dishwasher, bus boy, 
garbage collector, janitor, laborer, 
peddler, shoe shiner, window cleaner) 



Homemaker 



7 

8 



Not able to classify 9 



Mother's 
Occupation* 



tReligious. 
'Beckgrouhd* 



Religiosity 



Age Left 
Home* 



What type of work did your mother do mostly during the time when 
you were growing up? 

(RECORD^VERBATIM) 



^{GODE FROM LIST ABOVE) 



What was your religious upbringing? 
(i) None 

Protestant 
Catholic 
Other Chi'istlan 
Jewish 
Muslim 

Other" NonrChrlstlan 
Other (Specify: 



(2) 
(3) 
(4) 
(5) 

(6) 
(7) 
(8) 



.) 



How Important.ls-rellglon In your life? Would you say not 
Important, ajlttle Important, pretty Important, or very Important? 

(1) Not important 

(2) A little Important 

(3) Pretty Important 

(4) Very Important 

How old were you when you first left home to live at some other 
location? 

YEARS OLD 



Intact Home* 



Parental 
Drug Use* 



Up imtll you were 16 years old, dfd you alv/ays live with both your 
real mother ^d real father? 

(1) yes 

(2) no 

How would you describe your father's use of alcohol during the 
time when you were growing up? (SHOW CARD A)"** 

(1) Never drank 

(2) Light drinker 

(3) Moderate drinker 

(4) Heavy drinker 

(5) Very heavy drinker 

How would you describe your mother's use of alcohol during the 
time when you were growing up? (SHOW CARD A) 

(1) Never drank 

(2) Light drinker 

(3) Moderate drinker 

(4) Heavy drinker 

(5) Very heavy drlnlcer 

"*'Show cards may be foimd at the end of the Interview Items. 
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Parental 
Criminaiity 



Number of 
Siblings* 



Did either your mother or your father use heroin or other 
-narcotics? 

(1) Yes, father 

(2) Yes ^ mother 

(3) Yes, both 

(4) No, neither 

Has either your father or your mother ever been arrested? 

(1) Yesi father 

(2) Yes, mother 

(3) Yes, both 

(4) No, neither 

How many younger brothers and sisters do you have? 
NUMBER: 



Hew nxany older brothers and sisters do you have? 
NUMBERi 



Siblings' Were any of your brothers and sisters heavy drinkers? 

Drug Use* (1) Yes 

(2) No 

Did any of your brothers and sisters use heroin, or other 
narcotics? 

(1) Yes 

(2) No 

Siblings' Have any of your brothers and sisters ever been arrested? 

Criminality (1) Yes 

(2) No 



MILITARY 
EXPERIENCE* 



Have you ever been a member of the armed forces? 

(1) Yes 

(2) No SKIP REMAINING MILITARY QUESTIONS 

Bid you serve on active duty? (don't count Reserves, National 
Guard, or ROTO) 

(1) Yes rASK A.) 

(2) No 

A. When? From to 



(month, year) (month, year—expected 

date if still on active duty) 



Did you serve in Vietnam after 1969? 
(1) Yes 
12) No 
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TREATMENT 

Before" Entry* ^•Later lUl ask you some questions about the treatment program 

you wore in at . , which ended in (termination dat<^, 

mionth and year) . . But first, ..." 

Had you ever seen a doctor or been to a clinic or treatment center 
because of using narcotics before coming to this program? 

(1) Yes . . .ASK A 

(2) No SKIP TO QUESTION 

IF YES ; r 

\ 

A. How many times had you been in treatment for narcotics, 
altogether, before conaing tc this program? 

NUMBER .OF TIMES 



After Rel^se Have you seen a doctor or been in a treatment-center because of 
using narcotics since leaving the prograna? 
" (1)^ Yes . . . ASK A - . 

(2) No SKIP TO QUESTION 



IF YES : 

A. Approximately how long have you been in treatnaent since 
leaving^ ? 

NUMBER OF MONTHS 



How many times have you been in treatment for narcotics, 
altogether, since leaving this program? 

NUMBER OF TIMES 



Are you still in a treatment program? 

(1) Yes 

(2) No 
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Dates* 



Reason Left* 



Medications^ 



Treatment 
Types* 



ASK EACH QUESTION FOR EACH 

EPISODE OF TREATMENT 
BEFORE ENTERING PROGRAM 



'When did you enter treatment? 
(MONTH, YEAR) 

When did you leave treatment? 
(MONTH, YEAR) 

Why did you leave treatment? 

(1) completed treatment 

(2) transferred to another program 

(3) disch?a:ged for noncompliance with 

rules 

(4) left before completing program 

(5) incarcerated 

What medications were prescribed? 
(SHOW CARD B) 

(0) none 

(1) Methadone 

(2) LAAM, long-acting methadone 

(3) P.*opoxyphene-N, Darvon-N 

(4) Naloxone 

(5) Cyclazocine 

(6) Disulfiram, Antabuse 

(7) Naltrexone or other antagonist 

(8) Valium, Librium 

(9) Other tranquilizers 

(10) Other (Specify: ) 

What type(s) of treatment did you have*( 
(SHOW CARD C) 

(1) Methadone maintenance (3 weeks or 

more) 

(2) Detoxification (includes methadone 

less than 3 weeks) 

(3) Coimseling 

(4) Psychotherapy 

(5) OT or RT 

(6) Group Thierapy 

(7) Narcotic antagonist 

(8) Job training 



EPISODE 

'#1 ^#2 #3 



Remember to assign a separate column for coding for each 
category, since more than one answer is possible. 
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DEPENDENT VARIABLES 



During the last eight weeks, what were you doing most of the time — 
which one of the things listed on tLis card? (SHOW CARD D) 

(1) Working full-time 

(2) ' Working'i)art-time 

(3) With a job, but not at work because of temporary 

illness, vacation, strike, or temporary layoff 

(4) Unemployed, permanently laid off 

(5) Retired 

(6) In school 

(7) Homemaking 

(8) Other (Specify: ) 

Diuring the past eight weeks, about how many days did you work 
full-time (that is, seven hours or more) on legitimate jobs? 
RECORD NUMBER OF DAYS ACTUALLY WORKED. REMEMBER, 
THERE ARE 40 WEEKDAYS IN THE TIME PERIOD, 8 SATURDAYS 
AND 8 SUNDAYS. 

NUMBER OF DAYS - 



During the past eight weeks, about how many additional days did 
you work part-time on legitimate jobs? 

NUMBER OF DAYS 



IF ANY FULL-TIME OR PART-TIME WORK, ASK Q'S 
OTHERS , SKIP TO . 

9. A. What kind of work did you usually do during the past eight 
weeks? That is, what is your job called? (What ^re some 
of your main duties?) RECORD VERBATIM. 

B. What kind of a place do you work for? What do they make 
or do? RECORD VERBATIM. 

C. CODE RESPONDENT'S JOB; THEN GO TO D 
BELOW. Code 



Executives and heads of large companies ^ 
Major professionals (doctor, lawyer, CPA)| 

Managers and heads of smaller businesses 

or organizations 
Other professionals (registered nurse (RN), L . . . 2 

certified social worker (MSW), teacher, / * * * 

accountant) 

Administrative personnel (store manager) 
Owner of small businesses 
Professional artists (sculptor, musician) 
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Code 



Clerical and sales workers (bank teller, 

bookkeeper, stenographer, sales 

clerk, shipping clerk) 
Technicians (dental technician, draftsman) 
Self-employed or shop oy/ner (newsstand, 

^tailo;?-shop)' 
Para-professionals (trained counselor, 

other social worker) 

Skilled manual^ofkers (chef or head cook, 
licensed vocational nurse (LVN or LPN), 
electrician, machinist, painter, welder) 

Semi-skilled workers (short order cook, 
hospital aide, apprentice, bus driver, 
guard, machine operator, taxi driver, 
waitress) 

Unskilled workers (dishwas!ier, bus boy, 
garbage collector, janitor, laborer, 
peddler, shoe shiner, v adow 
cleaner) 



1- 



Not able to classify 

D. When did you start that job? 



Number of How many different employers (including current employer) have 
Employers you worked for in the last eight weeks, on legitimate jobs? 

NUMBER OF EMPLOYERS 

Amount of How much money did you make altogether —that is, take home pay 
Pay from (that/those) job(s) during the past eight weeks? 

DOLLARS 
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Sources of Please look at this card and tell me all of the things listed on it 
Support which have been legitimate sources of money or support to you 

during the past eight weeks. CODE ALL MENTIONED. IF MORE 

THAN ONE , ASK A. (SHOW CARD E) 

(1) Job 

(2) Unemployment compensation 

(3) Disability or workmen's compensation 

(4) Public assistance or welfare 

(5) Treatment program 
^{6y Husband or wife 

(7) Other family 

(8) Boyfriend or girlfriend^ 

(9) Other friends 

(10) Other (Specify: ) 
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IF MORE THAN ONE : 

Major Source A, Which one did you get the most money or support from? 

CODE 

Illegal Source Have you had any illegal sources of making money during the past 
eight weeks? (I don't need to know any details. ) 

(1) Yes . . . ASK A 

(2) No ... . SKIP TO QUESTION 

IF YES ; 

A. Haa that been a major source of money or support to you dur- 
ing the past eight weeks? 

(1) Yes 

(2) No 

Schooling During the past eight weeks, have you attended school at all? 

(1) Yes 

(2) No 



Training 



During the past eight weeks, have you had any vocational or job 
trainii^ (other than that you just mentioned)? 

(1) Yes 

(2) No 



TOBACCO AND 
ALCOHOL USE 

Tobacco Use 



Do you smoke cigarettes? 

(1) Yes . . . ASK A 

(2) No 

IF YES ; 

A. About how many cigarettes do you smoke each day? 

(1) Only smoke occasionally 

(2) Less than one pack 

(3) About one pack 

(4) Between one and two packs 

(5) About two packs 

(6) More than two packs 

(7) Other (Specify; ) 



Alcohol Are you currently in any kind of alcohol treatn'dnt program? 

Treatment (1) Yes 

(2) No 
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Alcohol Problems 



A. 

Have you ever 
had (READ 
EACH ITEM 
a-d) because 
of your 
drinking? 


B. 

! ASK B FOR EACH YES 
IN A: 

Was that more than 2 
months .ago or during the 
past 2 months, or both? 


Yes 


No 


More than 
2 months 
ago 


During 
past 2 
months 


Both 



a. Medical problems 



b. Problems on a job 



c. An Arrest 



d. Family trouble 



Alcohol Use About how often have you been drinking during the last two months? 
(SHOW CARD F) 

(1) Every day 

(2) Almost every day 

(3) 3 to 5 times a week 

(4) Once or twice a week 

(5) Once or twice a month 

(6) Not at all 



Occasions In the last two months, on how many occasions have you had five or 

Heavy Use more drinks in a row? 

NUMBER OF OCCASIONS 



Drug Use Now Fd like to ask r: few questions about drug use. During the past 

two months, about how often have you used (READ EACH ITEM 1-9) 
— would you say five to seven days a week, one to four days a week, 
less than once a week, or not at all? (SHOW (a-d) on CARD G) 



(1) Marihuana (CARD G-1) 

(2) Hallucinogens 

(CARD G-2) 

(3) Amphetamines (uppers) 

not prescribed 
(CARD G-3) 

(4) Cocaine (CARD G-4) 



5-7 1-4 
days days 
per per 
week week 

1 2 



Less than 
once 
a week 
(occasionally) 

3 



Not 
at 
all 



4 



Other 
(Specify) 

5 
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5-7 1-4 

^__day8 days 
per per 
week week 



(5) Tranquilizers (CARD G-5) 

(6) Barbiturates (downers) 

not prescribed 
(CARD G-6) 

(7) Herein (CARD G-7) 

(8) Methadone not prescribed 

(CARD G-8) 

(9) Ot)ier opiates not 

prescribed (CARD G-9) ■ 

(10) Other drugs not prescribed 
(Specify) 



2 
2 

2 

2 

2 
2 



Less than 
once 
a week 
(occasionally) 

3 

3 

3 
3 

3 

3 



Not 
at 
all 

4 

4 

4 
4 

4 
4 



Other 
(Specify) 

5 

5 

5 
5 

5 

5 



CRIMINAL ACTIVITY 

Arrests Have the police booked you on a charge or case in the past two 

months? 

(1) Yes (ASK A-C) 

(2) No 

IF YES ; 

A. How many times were you booked in the past two months? 
NUMBER OF TIMES. 

Charges B. ASK FOR EACH TIME MENTIONED IN A; What were the 

charges (each time)? RECORD BRIEFLY. 

FIRST TIME:_ 

SECOND TIME: 

HIRD TIME; 
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C. REVIEW CHARGES MENTIONED IN B, AND RECORD NEXT 
TO CATEGORIES BELOW, So you were cbo'ged ( Number ) 
times with ( CRIME ), does that seem correct? CONTINUE 
UNTIL ALL CHARGES ARE CODED BELOW. 

Number of times 
charged 

Crimes against persons — e.g. , assault, 
rape, battery, homicide, 

manslaughter. 

Crimes of profit ~e. g. , stealing, 
aimed robbery, robbery, 
burglary, forgery, theft, retain- 
ing money-under false-pretenses • 

Ding violations— e.g. , dealing, 
possession 

Prostitution, pimping or soliciting 

Other (Including minor offenses) 



Police During the past two months have you been picked up by the police 

Contact (taken to the station), but not booked on a charge or case? 

(1) Yes (ASK A) 

(2) No 

A. IF YES : How many times? ^NUMBER OF TIMES 

Self-Reports Now, without telling me any of the details, have you done any of the 
things listed on this card during the last 2 months for which you 
were not charged by the police? Let me start with the first 
category. 

Have you done any of the things In category (I) in the last 2 months? 
Just toll me yes or no. (SHOW CARD H) (REPEAT QUESTION FOR 
CATEGORY n, m, etc.) 

Yes No 

(a) I Shoplifting, plclq)ocketlng, burglars^ 1 2 

(b) n Purse-snatching, armid robbery, forgery, 

auto theft, blackmail, or extortion 1 2 

(c) in Arson, vandalism, or other damaging of 

property 1 2 
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Yes No 

(d) IV Assault, battery, muggii^, rape ; . i 2 

(e) V Soliciting, pimping, prostitution 1 2 

(f) VI Dealing in drugs, forging prescr/iptions, 

stealing drugs 1 2 

FOR FOLLOW- " CLIENTS 

Treatment Please think back to the treatment program you were in at 

gvaluatlon- which ended (TERM. DATE, 

. General MONTH & YEAR); ~ 

A. At that time was ( ) very easy for you to get to, 
fairly easy to get to, or hard to get to? 

(1) Very easy 

(2) Fairly easy 

(3) Hard 

B. Did most of the treatment staff you knew there perform their 
jobs very well,, pretty well, or not well, as far as you could 
tell? 

(1) Very well 

(2) Pretty well 

(3) Not well 

(4) Don't know (VOLUNTEERED) 

C. Did you gain a lot of vmderstanding of your drug problems, 
some understanding, or not very much understanding, as a 
result of treatment at that time? 

(1) A lot of understanding 

(2) Some 

(3) Not very much 

(4) Don't know (VOLUNTEERED) 

D. Did the staff there try to help you with other kinds of problems 
in your life or did they work only on drug problems? 

(1) Other kinds of problems too 

(2) Only dn^ problems 

(3) Don't know (VOLUNTEERED) 

Did you feel that any of the staff there cared about you as an 
individual and how your life turaed out? 

(1) Yes 

(2) No 

(3) Don't Know (VOLUNTEERED) 
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How-much individual treatment did you get. in that program— did you 
get a lot, some, a little, or none? 

(1) A lot 

(2) Some 

(3) A little 

(4) None 

(5) Don't know (VOLUNTEERED) 

Do you wish you could have had more individual attention? 

(1) Yes 

(2) No 

(3) Don't Know (VOLUNTEERED) 

Were you very satisfied with the drug treatment you received there, 
somewhat satisfied, or not at all satisfied? 

(1) Very satisfied 

(2) Somewhat satisfied 

(3) Not at all satisfied 

(4) Don't know (VOLUNTEERED) 

(No matter how you felt about your own exj>?vience there) was the 
program at that time good enough to recommend it to others? 

(1) Yes 

:(2) No 

(3) Don't Know (VOLUNTEERED) 

As far as you know, does the program have a good reputation, fair 
reputation, or poor reputation among drug users in this area? 

(1) Good 

(2) Fair 

(3) Poor 

(4) Don't Know (VOLUNTEERED) 

Was there anything you particularly liked about the drug treatment 
program? 

(1) Yss . . . ASK A 

(2) No 

A. IF YES ; What did you particularly like? (RECORD VERBATIM) 



Anything else? 

Was there anything you particularly disliked about the program? 

(1) Yes . . . ASK A 

(2) No 

A. IF YES ; What did you particularly dislike? (RECORD VERBATIM) 



Anything else? 
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How long was it after you left the treatment program before you 
took the drug (OR: one of the drugs) you had been treated for 
^ain? 

(1) Same day 

(2) 2 days - 6 days 

(3) 1 week - 4 weeks 

(4) 1 month - 3 months 

(5) more tha!i 3 months 

(6) Never (skip to question ) 



What drug was that? 
(list drug code) 



Now I have some more specific questions about the program. Pm 
going to read you some of the complaints clients have had about 
various drug programs. These don't necessarily apply to the 

program you were in at (SPONSORING 

AGENCY). However ,^ I would like to know If any of these do ^ply 

to your experience at (SPONSORING 

AGENCY). 

(CIRCLE APPROPRIATE CODE FOR EACH COMPLAINT. AFTER 
EACH YES, ASK:) 'Was that only a small or occasional problem 
or was it a big problem there? " 

Small 

^ Not a or Some Big 
"Okay, here is the first complaint: Problem Problem Problem 

(1) Too little contact with doctors- 
Did that apply to your experi- 
ence at 123 

(SPONSORING AGENCY)? 



(2) Foreign doctors who couldn't 

understand what you said \ 2 2 

(3) Too much medication given out 1 2 3 

(4) . 00 little medication given 1 2 3 

(5) Too little privacy— -you couldn't 

get away from other clients 1 2 3 

(6) Too boring, not enough to do 1 2 3 

(7) Too many unnecessary rules 1 2 3 

(8) Not treated with respect by 

staff 123 
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Perceived 
Helpfulness 
of Treatment 



Small 

Not a or Some Big 
Problem Problem Problem 



1 
1 



2 
2 



(9) Not enough staff 

(10) Illicit drugs available 

(11) Clients were kept in treatment 
too long 1 2 

(12) Clients were made to leave 
treatment too early 1 2 

(13) People were put on 
methadone maintenance who 
didn't.really need it 12 

(14) Not enough help getting job 1 2 

(15) Not enough opportunity for 

job training 12 3 

(16) Too little oppo^t^mity for 

group therapy 12 3 

(17) Too little opportunity for 
individual therapy or 

counseling 12 3 

"Being in a drug problem can help clients in a lot of different ways 
Bid being in the program at 



3 
3 

3 

3 

3 
3 



(SPONSORING AGENCY) (from ^ (MONTH, 

YEAR) to (MONTH, YEAR) help you In any of 

the following ways? " 

(IF THE ANSWER IS NO TO ANY OF THESE, ASK: 
»«Dld you need that kind of help when you were there? ") 



No, but No, and 
Yes Not Needed Needed 

(1) Did the program reduce your 
use of the drug you were being 

treated for? 12 3 

(2) Did the program get you off the 
drag that you were being 

treated for? 12 3 
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No, but No, and 
Yes Not Needed Needed 



(3) Did the program help you get 
off diugs other than your main 

drug of abuse? 1 2 

(4) Did the program help you stay 

oat of jail? 1 2 

(5) Did the program help you get 

a job? 1 2 

(6) Did the program help your state 
of mind, mak i you feel better, 

less depressed, etc. ? 12 

(7) Did being in the program get 
you help with a physical health 

problem? 1 2 

(8) Did the program help you reduce 

yoxa: drinking? 1 2 

(9) Did the program help you reduce 

your smoking? 1 2 

(10) Did the program give you an 
opportunity to make new 

friends you still have? l 2 

(11) Did the program give you an 
opportuaity to get more edjica- 
tion or training than you would 

have otherwise? 1 2 

(12) Did the program help you learn 
to get along with other people 

better? 1 o 
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OTHER VARIABLES 



living Place "Sftere have ycu lived most of the time for the past two months — 
wMch of the pli^ces Dated on the card? (SHOW CARD I) 

( t) Apartment or single family house (ASK A)' 

(2) Hotel ...... (ASK A) 

(3) RoQXQjiig or boarding house (ASK A) 

(4) Hospital.. . (ASK A) 

(5) Ther^Qutic community (Lot hospital). (ASK A) 

(6) Jail or prison (ASK A) 

(7) Other (SPECIFY & ASK A) 



<3) No regular place 

Stability of A. IF CODES 1-7: How many places (except jail, prison or 
Residence therapeutic community) have you lived in ^ing the past two 

months? 

NUMBER OF RESIDENCIES 



Living -With . Who have you been ilvlog with most of the time for the past two 
months? (PROBE: Anyone else?) CODE ALL THAT APPLY. 
(SHOW CARD J) . 

(1) Husband/wife 

(2) Boyfriend/girlfriend 

(3) Other: ii-iends 

(4) Parents 

(5) Other relatives 

(6) Alone 



(7) Other (Specify: ) 

Marital Status Are you currently miarried, separatx.d, divorced, widowed, or 
haven't you ever been married? 

(1) Married (or living is married) ASK A & B 

(2) Separated ASK A & B 

(3) Divorced ASK A 

(4) Widowed ASK A 

(b) Other (Specify: ) ASIC A 

(6) Single, never married 



# 

A. IF EVER MARRIED. CODES 1-5 : Altogether, how many tJmes 
have you been married — legally, common law, or living a& 
married? 

NUMBER OF TIMES 
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Number of 
Dependents 



Urine 
Sample 



Urine 
Results 



B. IF^CODES 1-2 ; How satisfied are you with your marriage- 
would you say very satisfied, somewhat satisfied, or not at all 
satisfied? 
(1) Very satisfied 

(2): Somewhat satisfied 

(3) Not'at all satisfied 

How many persons are dependent, partially or totally, on you for 
financial support at the present time (not including yourseU)? 

NUMBER OF PERSONS 



That's about all the questions we have. The last thing we need is 
a urine sample. It will-be semt to a lab, where it will be analyzed 
for drugs. Your name will not be on it (SHOW ADDRESSED CON- 
TAINER), and it will never be identified with you in any way. 



CODE WHETHER GAVE SAMPLE OR NOT ; 

(1) Gave. sample 

(2) Unable to give 

(3) Refused (Specify reason: 



ASK WHETHER OR NOT GAVE SAMPI,E . 

Ttd urine v/ill (would) be checked for all of the drugs on this card. 
The drugs usually show up on the tests if a person has taken any . 
within the last th'^ee four days. And, of covurse, they show up 
whether they were p*. ii. :ribed by a doctoi* or bc-..,ght on the street. 
(SHOW CARD K) 

Do you think any of these might show (have ahown) up h. year urins? 

(1) Yes ASK A 

(2) No 



A. IF YES ; Which ones? 
READ AND CODE EACH 
ITEM. THEN ASK (1) 
AND (2) FOR EACH "YES" 
BEFORE GOING TO NEXT. 



ASK FOR EACH "YES" 
EXCEPT HEROIN; Are you 
using (DRUG) under a doctor's 
direction for medical treat- 
ment, or on your own? 

Doctor's On 
Yes No Direction Own 



Heroin? 

Methadone? 

Codeine? 

Other Narcotics? 

Uppers? 

Downers? 



2 
2 
2 
2 
2 
2 



XXX 



XXX 
2 
2 
2 
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Other ' ASK IF GAVE SAMPLE ; 

Medicines 



Have you taken any, (other) medicines at all in the last two days? 
I'm asking because certain. medicines can be confused by the 
laboratory with the drugs they are testing for. 

(1) Yes (Specify: _ . , . ) 

(2) No . 
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SHOW CARDS 



Cards labeled A, B, C, D, etc. can be printed and arranged in alphabetical 
sequence.on a binder ring for easy reference by both the interviewer and the 
respondent, iinytime a show card is used with a question, the interviewer 
should turn to the appropriate card on the ring and hand it to the respondent. 
If the respondent cannot read, the interviewer can simply read contents out loud. 



CARD A 

(1) NBver drank 

(2) Light drinker 

(3) Modorate drinker 

(4) HoaTy drinker 

(5) Very neavy dr^uker 



CARD C 

(1) Methadone maintenance (3 weel:s 
or more on methadone) 

(2) Detoxification (includes methadone 
less than 3 weeks) 

(3) Counseling 

(4) Psychotherapy 

(5) OT or RT 

(6) Group therapy 

(?) Narcotic antagonist 
(8) Job training 



CARD E 

(1) Job 

(2) Unemployment compensation 

(3) Disability or workm^tm^s compen- 
sation 

(4) Public assistance or welfare 

(5) 'Treatment program 

(6) Huaband or wife 

(7) Other family 

(8) Boy friend or girl friend 

(9) Other friends 

(0) Other ^SPECIFY) 



CARD B 

(0) None 

(1) Methadone 

(2) LAAM, long-acting methadone 

(3) Propoxyphene-N, Darvon-N 

(4) Naloxene 

(5) Cyclazocine 

(6) Disulfiram, antabuse 

(7) Other antagonist 

(8) Valium, librium 

(9) Otiier iranuuilizers (meprobamates 
haldol, thorazjine, stelazino, 
mellaril, miltown, etc.) 

(10) Other (Sp^<3ified: ) 



CARDD 

(1) Working full time 

(2) Working part time 

(3) W*th a job, but not at work because 
of temporary illness, vacation, 
strike, temporarj^ layoff 

(4) Unemployed, permanently laid off 

(5) Retired 

(6) In school 

(7) Homemaking 

(8) Other (SPECIFY) 



CARD F 

(1) Every day 

(2) Almost every day 

(3) 3 to 5 times a week 

(4) Once or twice a week 
CS) Once or twice a laonth 



CARDG 

(a) 5 to 7 days per week 

(b) 1 to 4 days per week 

(c) Less than once a week 
(Occasionally) 

(d) Not at all 

(1) Marihuana (or hashish)* 

(2) Hallucinogens (LSD, mescaline, 
peyote, psilocybin, DMT) 

(3) Amphetamines ('\ippers, " 
dexedrine, methedrine, dextro- 
amphetamine, ritalin) 

(4) Cocaine 

(5) Tranquilizers (vallum, librium, 
meprobamaces, haldol, thorazine, 
stelazine, mellfvril, miltown) 

(6) Barbitura ;S anci otiis?<r sedatives 
("downers, "barbital, Seconal, 
quaalude, methaquaione) 

(7) Heroin 

(8) Methadone 

(9) Other opiates (opium, morphine, 
codeine, demerol, dilaudid, 
paregoric, talwin, laudanum) 



CARD H 

L Shoplifting, pickpocketing, 
burglary 

n. Purse-SDatching, armed robbery, 
^ forgery, auto theft, blackmail, 

extortion 
IIL Arson, vandalism, or other 

damaging of property 

IV. Assault, battery, mugging, rape 

V, Soliciting, pimping, prostitution 
VI, Dealing in drugo, forging 

prescriptions, stealing drugs 





CARD I 






CARD J 


(1) 


Apartment or single family house 




(1) 


Husband/ wife 


(2) 


Hotel 




(2) 


Boy friend/girl friend 


(3) 


Rooming or boarding house 




(3) 


Other friends 


(4) 


Hospital 




(4) 


Alone 


(5) 


Therapeutic community (not 




(5) 


Other (SPECIFY) 




hospital) 








(6) 


Jail or prison 








(7) 


Other (SPECIFY) 








(8) 


No regular place 









^Actually, nin^, different cards should be used here, one for each drug, 
with the description of the drug at the top of tlie card. 



185 



ERIC 



CARDK 

su Heroin 

b. Methadone 

c. Codeine 

d. Other narcotics (opium, morphine, codeine,, demerol, dilaudid, paregoric, 
talwin, laudanum) 

e. Uppers (amphetamines, cccaine, dexedrine, methedrine, dextro- 
amphetamine, ritalin) 

f. Tranquilizers (valium, librium, meprobamates. haldol, thorazine, stelazine, 
mellaril, mil town) 

g. Downers (battiturates, barbital, seconal^ quaalude, methaqualone) 



ERLC 



1S6 



174 



APPEiMDIX F 

SAMPLE LETTER OF INTRODUCTION FOR INTERVIEWERS 



Dear Hespondent; 

I have written this letter to intrcxiuce you to an interviewer who will have an identifica- 
tion card from the X Research Center. The Center is assisting us in a foUowr 
up study. This is a continuation of the evaluation that was done while you were in 
treatment here. The interviewer will talk with you about how your life has been since 
then. 

The purpose of this study is to learn now different types of treatment help different 
types of people with their problems. You are one of 200 people who have been ran- 
domly selected for interview. 

You will be pa^.d a fee of X dollars for your time and consideration,. 

Your participation is pursly voluntary and you have the right to refuse to be interviewed 
without fear of any c jcsequences for doing so. .However, I hope that you will cooperate, 
as this information is greatly needed in order to find out how well various treatments 
work. 

Because of the Ihws of confidentiality, none of this iRiorui^tion you give can be re- 
leased to anyone, including us, without your written permission. 

I am personally convinced of the importance of this project. If you wish to discuss 
this pro>.ct with me or our staff, please feel fre.e to do so. 



Sincerely yours. 



Director 
X 



Treatment Center 
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APPENDIX G 



SELECTED CASE STUDIES: 
LOCATING RESEARCH-SUBJECTS* 



Case* No. 1: Fear of Arrest 

base No* 2: Alcoholism 

Gase^No. 3: Reluctaace to Cooperate 



FEAR OF ARREST 

Some respondents live in constant fear of arrest because of criminal activity apart 
from drug. law violation. Their determined hiding from police considerably compli- 
cates the study staff's efforts to locate them; moreover, their fugitive status heightens 
their suspicion of the study's "real'' motive, and increases their reluctance to be in- 
terviewed. These obstacles confronted the staff throughout the locating effort dis- 
cussed below. 

Case No. 1 : Mr. Charles 

Mcrmation obtained from law enforcement and correctional agencies disclosed that 
Mr. Charles was being sought not only by the police but also by the department of 
parole and probation for offenses and charges falling within their respective jurisdic- 
tions. These difficulties had begun in August, 1971, when Mr. Charles waa arrested 
for violation of narcotic laws in his city. At the time of his arrest, he way on parole 
after serving part of a ten-year sentence for a similar offense. 

By obtaining bail shortly after his 1971 arrest, Mr. Charles managed to be released 
before his parole officer discovered that he had been in custody. As a result, a 
warraut.for his arrest was issued charging violation of parole, as well as a warrant 
involving his failure to appear on the new charges of violation of narcotic laws. These 
warrants were still outstanding when we began our search for Mr. Charles. 

Turning to local addicts for information, we learned that Mr. Charles was living in 
New Yoi*k in Harlem, and was ''dealing hard. " (This meant not only that he was deal- 
ing hard drugs ~ heroin and cocaine — but also that he was hard at dealin^.) 

If Mr. Charles was indeed in New York, it seemed possible that Mr. Raymond, the 
study staff's special contact there, could help find him. Accoroingly, two staff mem- 
bers and a locator, accompanied by a trained interviewer, drove to New York City in 
early December, 1973, and attempted to contact M Raymond. Finding that he was 



All cases reported here are actual experiences encountered by the staff of a recent 
survey in an American metropolitan area, although the subjects* actual names have 
not been used. 
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not at his home in Harlem, we left a note telling him that we would call back, and then 
went alone to an area that we knew was both a major marketplace tor heroin and a 
meeting /vace where local and out-of-state addicts congregated. Within minutes we 
learned from addicts personally known to us that Mr. Charles was living in New York. 
We were told that only a few days earlier Mr. Charles had absconded with a large sum 
of money given to him by ''some bad dudes'* in a heroin transaction. No one had seen 
him since, and word was circulating through the neighborhood that he would be shot on 
sight if he had 3pent or otherwise misused the money entrusted to him. No one to whom 
^e spoke would admit to any knowledge about Mr. Charles* hiding place, or about his 
source for the drugs he needed for his ongoing habit. A prostitute in the crowd com- 
mented that since Mr. Charles had a ''dealer's habit, '* he could not stay away from tbo 
scene too long. 

We did noc tell his acquaintances that we wanted to interview Mr. Charles and fell ^,hat 
under the circumstances it was best to leave no messages at all. Before leaving, how- 
ever, we obtained an address for another study respondent who reportedly lived in the 
area. The address proved correct, and the subject was located and intenaewed that 
evening in the hotel where we were staying. 

The next morning we were successful in contacting Mr. Raymond, who knew all the . 
circumstances of Mr. Charles' disappearance. He told us that he aid not know where 
Mr. Charles was hiding, but promised to try to find out. Together the locator and Mr. 
Raymond spent the next several hours hunting for information about Mr. Chanes, but 
to no avail. Before parting from Mr. Raymond that night, we asked him to call if he 
learned anything new — and around 2:00 a.m. Mr. Raymond telephoned. 

Within the hour we and Mr. Raymond were inside a well known sleazy hotel in down- 
town Brooklyn which caters t: prostitutes, pimps, addicts, and homosexuals. Mr. 
Rajnnond told the clerk that ht .vished to speak to the occupant of room 710 — he was 
unsure whether Mr. Charles had registered under his own name, but he was certain 
that the room avimber was correct because "it came from a good source. " He would 
not divulge this source, however. 

The telephone was finally answered by Mr. Charles himself. He would not allow us or 
Mr. Raymond to go up to his room, but he was willing to meet us in Ine lobby, and did. 
Later he explained that he had company in his room and that his room was small. 

We introduced ourselves, explained the study, and told Mr. Charles that the agency we 
represented would appreciate havitig his interview. We stressed the study's concern 
for confidentiality, and assured Mr. Charles that his whereabouts would never be 
divulged to anyone. We also informed Mr. Cbarlos that we were aware of his legal 
difficulties in his home city, a gesture of honesty that seemed to reassure him. Ap- 
parently feeling ^hat if we intended to do him harm we would have done so already, Mr. 
Charles agreed to cooperate and give the interview later that morning. At his request 
it took place in his hotel room at 10:00 a. m. , and it went without incident except for 
the fact that his girlfriend refused to leave the room and permit the privacy that we 
would have preferred. 

So far as is known at this time, Mr. Charles continues to be a fugitive from justice. 
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ALCOHOLISM 



Very often narcotic addicts become alcoholic as well. When this happens, they tend 
to move often from place to place, staying in one location only a short while before 
their alcoholism precipitates behavior that forces them to move on once more. Be- 
cause of their unstable lifestyle and erratic behavior, they leave few traces behind; 
thus they are difficult to locate. The following account of Mr. William illustrates the 
study's experience in finding one highly mobile respondent who had developed serious 
alcoholism. 

Case No. 2: Mr. William 

Although Mr. William had been arrested in the 1959s and had served a short sentence, 
his jail record was so old it was inaccessible. Therefore we turned to police records, 
and learned that he had been arrested in another state after his local incarceration. A 
check of that state's police records revealed that the charge against Mr. William 
(molesting a minor) had not be^n pressed, and so he was released. Neither state nor 
local police had any information about him after his release. Two of his former em- 
ployers and several individuals at the boarding house where he had lived were con- 
tacted, but none of them knew anything about Mr. William's current whereabouts. 

However, one fact furnished by the police enabled us to locate Mr. WilUam eventually; 
we learned through these contacts that he had become an alcoholic. Upon learning 
this, we identified several treatment facilities for alcoholics within a fifty -mile radius 
of Mr. William's last known location. The second one at which we inquired had indeed 
treated Mr. William and had records that included the names and addresses of some 
relatives but all were bogus. The personnel at the treatment facility reported that 
several months before, Mr. William had been released from their care and admitted 
to a half-way house elsewhere in the state from ivhich he had been expelled (for 
drinking) on the same day he was admitted. 

We then contacted the welfare department in the county m wh.jh the half-way nouse 
was located. Personnel there reported that Mr. William h^i applied for assistance 
from t\e county while he was hospitalized at a state hospital. From this hospital the 
study staff obtained an address for Mr. William, but chech.ng it produced only the 
fact that Mr. William had moved on once more. Several additional addresses were 
found and checked out, but no useful information emerged until the trail led to a V. A. 
hospital. Mr. William had been a patient there, Lat left aga^.nst medical advice ap- 
parently because he was accused of stealing money from another patient, something 
that had occurred more than once before in his past. 

According to hospital records, Mr. William had presented himself at one time in the 
recent past to the alcoholic unit of the Salvation Army. From this source came infor- 
mation that Mr. William haS previously been a patient in still another state hospital, 
so we checked there. We found that he had been readmitted and was at that moment 
still hospitalized there. A telephone call to his physician resulted In arrangements 
for an interview, whi^^h was obtained promptly by an interviewer who traveled from 
our office to the hos»^;itaI and had a successful meeting with Mr. William. 



ERIC 



178 

190 



RELUCTANCE TO COOPERATE 



Sonr oTthe study subjects who are exceedingly hard to locate present an additional 
problem after they are finally found: they are reluctant to cooperate with the study. 
The fear, hostility, resistance, or simple indifference of some individuals can be 
very difficult to overcome and sometimes cannot be overcome. The following case 
shows how one interview arranged through unusual effort was nearly thwarted by in- 
tervening circumstances. 

Case No. 3: Mr. Roberts 

The only address nvsilable for Mr. Roberts was that of his father as given on Mr. 
Roberts' local pcllc^- recci^:. Wher we were u jDle to reach the father by telephone, 
we went to the l\c-ne ?tad Learnr^ fx',m a neighbor that the senior Mr. Roberts had died 
a few monli.s befc^^. The neif/'bor reported that the son had come for the funeral, 
but she W not know where he lived. However, she did know that a lawyer was 
handling the estate, and she was able to give us the lawyer's name. Through the 
lawyer V3 learned that Mr. Roberts lived on the opposite coast* 

By letter and then by phone, the study contacted Mr. Roberts and be agreed to be in- 
terviewed by one of our colleagues, a professor at a imiversity near Mr, Roberts' 
home. At the appointed time, the interviewer went to Mr. Roberts' residence, found 
him there alone (and drinking), and began the interview. After about an hour of con- 
versation, however, the .aterview had to be terminated. Mr. Roberts had become so 
drunk that he lost consciousness. 

Several days later the interviewer returned to the house to make another personal con- 
tact v;VJx Mr. Roberts. This time he met Mrs. Roberts, a woman born and raised in 
the Orient, who was very suspicious of us and our motives. She felt that we were in- 
volved in a conspiracy to swindle Mr. Roberts out of his inheritance, and she urged her 
husband not to cooperate further with the inter/iewer or the study. 

Mr. Roberts did not feel this way, however. He was actually very sympathetic with 
the study's purpose, and wished to make good his original promise to help. Without 
his wife's knov'ing it, we contacted him again and he made another private appointment 
w^'tJi the interviewer, kept it, aiid completed the 'nterview satisfactorily. 
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APPENDIX H 



THE SELECTION AND SUPERVISION 
OF INTERVIEWERS 



SELECTION OF INTERVIEWERS 

It will facilitate the interviewing process if the interviewers are recruited from the 
area where the client population is to be found. The problem of recruiting interviewers 
is simplified by the fact that most clients receive treatment within a few hundred miles 
of the place they consider to.be homec (Large V. A. or other federal government 
centers and hospitals may be an exception to this rule.) Experience also shows that 
most people 5 including people with drug problems, do not move far when they move, 
even if they move often. Recent studies have shown that 70 per cent of all clients 
treated in urban centers will still be livirig in the area two or three years later. 
Therefore, the survey administrator has little problem in deciding how to apportion 
interviewers geographically. If the center is near a metropolitan area to which a fair 
number of respondents may have moved, it would be wise to choose some interviewers 
who live in that area. 

Recruiting Procedures 

When programs recruit interviewers, ads in local newspapers and on radio stations 
T/iil usually produce an ample supply of applicants. The following ad has been used 
successfully: "Part-time inter^/iewing for X Research Center. Men or women. 
Flexible schedule. Use of car necessary. No experience required. Call Ms. Jones, 
243-6005. " 

In con^munities where it is wise to keep a low public profile, the ad can be blind: in 
such a case the ad tells the applicant to call a special number (assigned for this pur- 
pose), and to ask for a name (also assigned to identify callers as applicants). When 
applicants call in, the phone conversation should be kept as brief as possible: its 
main purpose is to get the applicant's name and address. Then materials should be 
tent to the applicants who called in* These materials should include the following: 
(1) a brief description of the job; (2) the pay rate; (3) the time requirements, by day 
or by week; (4) beginning and ending dates for the job; (5) any other conditions of work 
that are required, such as a car, availability dur>g evening hours, or availability for 
travel; (6) any basic educational requirements, such as high school graduate or seme 
college; and (7) an invitation to call for an appointment. Some callers will disqualify 
themselves upon receiving this material. Others will remain interested and call back 
for an appointment. 

Recruitment Interviews 

In the recruitment interview, applicants should complete application forms, '^hey 
should also have the opportunity to ask questions about the job, and to get as much in- 
formation as possible. At this time, applicants are also sometime : asked to complete 
a trial interview with a friend or a stranger, or both. You should have available a 
Simple document, designed for this purpose, requiring the person to follow clear in- 
structions. If the applidt does these tasks well, and has the other general charac- 
teristics needed for tiie study, this is probably a good person to hire. As a final step 
it is aiwaya a good idea to check the business references of a person prior to hiring. 
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It should be noted that in most instances, you will screen two or three times the num- 
~ber of people you plan to hire. 



Paying Intorviewers 

Once you have actually hired a prospective interviewer, you should pay for all training 
and preparation for interviewing. In 1976, starting rates for interviewers were ap- 
proximately $4.00 per hour. 

In the past, some interviewing organizations have paid interviewers 'by the case, " a 
sort of piece work payment. This practice is becoming increasingly uncommon be- 
cause of the potential legal difficulties it presents. Computations of overtime for this 
type of employee are difficult. For employees paid by the case, it is necessary to 
estimate the hourly rate and the number of hours represented by each case, so that an 
employee who has completed cases representing more than 40 hours per week can have 
overtime computed. Thus it is far simpler to pay interviewers for the hours they have 
worked. Experience shows that if interviewers are well supervised, they will spend 
their time wisely and work efficiently. 



Procedures for Validations 

Validations should be carried out in a manner consistent with the promise of confiden- 
tiality that the interviewer made to the respondeat during the interview. To prepare 
the respondent for a possible validation, the interviewer should tell him something like 
the fo 'owing at the time of the interview: 

'^My office may call you to check on this interview. This is a necessary 
part of the research. The person who calls will know that you have 
completed the interview, but will not know any of the answers you have 
given to me. You may be asked to answer a few questions again. This 
is a routine procedure — your answers to the validator will be kept as 
confidential as the ones you have given me. " 

Some respondents within the group or sample may be uneasy about validation, particu- 
larly a respondent in fear of being found by the law. If these respondents are asked to 
sign some document, perhaps a receipt for payment, validation of the signature against 
the signature in treatment records may be sufficient. If validation by signature is not 
possible, the questions used to validate the interview with such respondents should be 
limited to the following: (1) verify the date of the interview; (2) determine how long 
the interview took (look for gross differences); and (3) ask a question that verifies the 
respondent's identity, such as his birthdate. Researchers should be aware that even 
the most unthreatening questions may cause anxiefy in these respondents. They may 
wonder: "Why do they want to know what I was doing on THAT date? Therefore, the 
validator must be prepared to reassure any respondent whose interview is being 
validated. In addition, it Is important to recognize that the validation answers may not 
be the same as those in the interview, even when the interviewer is totally honest. For 
example, the interviewer may record that it took 90 minutes to complete the interview, 
but the respondent's memory may vary by 30 minutes in either direction. 
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For this reason, it is a good rule of thumb to limit the validation to questions to which 
' the respondent certainly knows ' the answer and about which-he has -no reason to lie. 
Questipns about his birth date, his mother^s name, or whether he is married are 
better than- questions about last year's income or the number of times he has been to 
the doctor in.the, last year. 

Validations are. usually completed by phone.. Ideally, this should be done as soon as 
possible, after the interview. If the respondent has no phone, it may be necessary to 
validate the interview by another personal visit. As a rule, validations should not 
last more than five to ten minutes. It is important that^the validator should not know 
the original answers to the question, because this has been shown to bias the validation. 

Even when the interview schedule disagrees with answers obtained in the validation, it 
should-not automatically be assumed that the interviewer is dishonest. When dis- 
crepancies are found, the interviewer should be stopped from working for a day or two 
yibile several more interviews are validatedj^ preferably those completed recently, 
if there is consistent evidence of discrepancy, then all the interviewer's work should 
be checked. However, if, no such evidence is found, the interviewer should be allowed 
to resume work immediately. Some researchers increase the validation rate for in- 
terviewers who have had previous validation discrepancies as an extra safeguard. 
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ACADEMIC SURVEY GROUPS 



Survey Research Laboratory 
Arizona State University 
Tempe, AZ 85281 
602-965-5000 

Research Triangle Institute 

P.O. Box 12194 

Research Triangle, NC 27709 

919-549-8311 

Social Science Research Institute 
University of Maine 
164 College Avenue 
Orono, ME 04473 

Survey Research Center 
SUNY 

Buffalo, NY 14214 
716-831-1675 

Survey Research Center 
University of Michigan 
P.O. Box 1248 
Ann Aibor, MI 48106 

Survey Research Program 
University of Massachusetts 
100 Arlington St. 
Boston, MA 02116 
61'^-542-7037 

Survey Research Center 
U. of California at Berkeley 
2220 Piedmont Ave. 
Berkeley, CA 94720 
415-642-6569 

Institute for Social Science Research 
UCLA - 405 Hilgard 
Los Angeles, CA 90024 
213-825-0711 

Bureau of Social Science Ret^earch, Inc. 
1990 'M^St., N.W. 
Washington, DC 20036 
2^2-223-4300 ext. 204 



Bureau of Social Science Research, Inc. 
1990 »»M»» St. , N.W. 
Washington, DC 20C j6 
202-223-4300 ext. 204 



National Opinion Research Center 
6030 South Ellis Avenue 
Chicago, IL 60637 
312-753-1300 

Educational Assessment Center 
University of Washington 
Seattle, WA 98195 
206-543-1170 

Survey Research Laboratory 
University of Illinois 
414 David Kinley Hall 
Urbana, IL 61801 

Survey Research Center 
York University 
4700 Keel St. 

Downsview, Ontario, Canada M3 J 1F3 
416-667-3022 

Survey Research Laboratory 
University of Wisconsin 
610 Lowell Hall 
Madison, WI 53706 
608-262-3122 

Institute for Survey Research 
Temple University 
1601 N. Broad St. 
Philadelphia, PA 19122 

215- 787-8351 

Cleveland Area Survey 
Western*"Reserve University 
Cleveland, OH 44106 

216- 368-2677 
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APPENDIX J 



PROBING TECHNIQUES FOR INTERVIEWERS 



PROBING WITH PRECODED QUESTIONS 



The material mthis appendix has been ad^ted from J, S, Morse, Interviewer training 
Manual (Chicago; National Opinion Research Center, 1976), ' 

The probing techniique is used with both preceded questions, and open-ended questions, 
but in different ways. Inters iewers should be fully familiar with these probing tech- 
niques. They may profitably be practiced during any training classes for interviewers. 

Preceded questions are used in questionnaires when researchers have a good idea of 
the range o£ possible answers to a question, such as whether the respondent's house 
is rented or being bought. Preceded questions are also used when researchers want 
the recpondent (R) to place himself or his opinionsrin one of several descriptive cate- 
gories. With preceded questionnaires, probing is used to focus the R's attention on 
the question aix3/or to direct the R's attention to the existing code categories. In all 
cases when the R does not respond with a code eateogry, the response should be re- 
corded verbatim nefore it is probed. , 

When th? Respondent Answers "Between Gategories" 

Occasionally the respondent will answer 'TDetween categories. " For example: 

Q: Would you say your health is excellent, veiy good, good, fair, or 

poor? 
A: It^sOK. 

^en this situation arises, probing teaches the respondent to be a respondent: by re- 
peating the question and the categories, the interviewer indicates to the R that his job 
is to choose one of them. In this situation the interviewer has two distinct jobs: 
(1) to repeat all categories for the R, in order to avoid narrowing down his choice; 
and (2) to preface the repetition with some remark which indicates that the R needs, to 
make a choice. The interviewer should never just rattle off the question again. For 

example, the interviewer mi^t start with 'Veil then, would you say ^, " or Vhich 

comes closest , " or *ln general . " 

In every case the interviewer must be sure that the prefacing remaric indicates to the 

R what to do. Thus, if the R says 'It depends, ^' a remark such as 'In general is 

appropriate because it tells the R that his generalizations on the subject are desired. 
Cn the other hand, if the R answers in his own words instead of using an answer cate- 
gory, the interviewer should use a prefacing remark such as 'Hvhich comes closert 

, . " This will indicate that the interviewer is interested only in the specific cate- 
gories listed on the questionnaire, and that the R needs to make a choice aiuong these. 

When the Respondent Misunderstands a Question 

Listening carefully is a very important part of interviewing. There are several clues 
to alert the interviewer to the possibilily that the R may have misunderstood the 
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question, such as not answering within a code category, or answering with an incorrect 
category -.(an.answer which.incorporates^part of an existing category, but is mot-the 
same). If it appears that the R misunderstood the question, the interviewer should 
acknowledge his response ("I see" is neutral acknowledgement) and repeat the question 
for him. 

When the Respondent Answers "I Don't Know" 

If the R.says "I don't know, " it may mean one of several things, and the interviewer 
should.be alert.to the various possibilities. Clearly, "Don't Know" is the easiest 
answer to any question. The respondent may not. understand. that the interviewer really 
wants a thoughtful answer. The best way to communicate-this expectation to the re- 
spondent is to use. what is called a silent probe. That is, the interviewer should 
simply pause and look expectantly at the respondent, indicating that "Don't Know" is 
expected to be a preface to an answer. 

"Don't Know" may also mean "I haven't really thought about it. " If this appears to be 
the case, the interviewer should reassure the respondent by communicating a willing- 
ness to wait while he thinks about it. A remark such as "I wonder if you could take a 
minute to think about it (repeating the question)" is appropriate. Finally, of course, 
"Don't Know" can mean just that: "I haven't the faintest idea. " In order to be sure 
this is the case, the interviewer should always probe a "Don't Know" at least once. If 
the R still answers "Don't Know" (DK), the interviewer should code or record this' 
answer as such and go on to the next question. (Many questions have a DK code cate- 
groy which is not read to the respondent.) It is important to remember that the point 
-of probing a "Don't Know" is not to force the R to give an answer, but rather to give 
him the chance to think about a response. 

If the R still has not chosen an existing code category after these various types of prob- 
ing, the interviewer should record his final response verbatim and go on to the next 
question. 



PROBING WITH OPEN-ENDED QUESTIONS 

Open-ended questions are used when researchers do not feel they know the full range 
of possible answers to a question. For this reason, it is particularly important for the 
R to have the chance to provide complete information, and to say everything he has to 
say. In order to meet this need, two kinds of probing are required when open-ended 
questions are used. First, answers should be probed for clarity. Next, the inter- 
viewer must probe for additional information. 

Probing for Clarity 

Two tasks are involved. First, the R's response must be evaluated. Does the inter- 
viewer know exactly what he means? Will someone else reading his response have the 
same understanding of his meaning? If the answer is not clear, the interviewer must 
then decide how to probe it in order to clarify its meaning. It is well to recall in thio 
context that open-ended questions tend to be very general, such as asking the respondent 
what he thinks, or why he feels a particular way. As a result, respondents tend to 
answer such questions in a general way, and to use general adjectives- to describe 
situations and opinions. Thus, probing for clarity may mean asking for a more specific 
response, or for an explanation of a term. 
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Some exarapleS'of the need for clarification follow. As indicated, a good tecLnique in- 
.yplyes,.rei\eating. the;W^ ttiat needs clarification to the R as a question: 

The location? Your mother? 

Q: Why did you choose this place to live? 

Aj,: I like the water (which water?) 

Agt I like the location (why? ) 

Agt I like the size (of what?) 

A-: It's convenient (to what? for whom?) 

A|:; Because of -the neighborhood (what about the neighborhood?) 



Agi Because of my mother (what about her?) 

/As these examples suggest, the best probes for clarity are the ones which tell the R 
.eKactly what the interviewer wants him to do, or needs to know: 

What do you mean : ? 

Could you be more specific ? 

Could you tell me a little more about that? 

After probing, the interviewer should evaluate the response to the probe in order to 
determine if Ihe answer is now clear. If not, further probing may be necessary. In 
order to avoid making the R feel harassed, some prefacing remark might be helpful, 
such as want to be sure that I understand what you mean here. When the R has 
clarified a response, this is a gockJ time for some positive feedback. Two examples 
of ihis technique might include '1 see" and a nod of the head,- or '^That's the kind of 
specific information I'm looking for. " 

If the R's answers contain several points that need clarification, the interviewer should 
deal with these one at a time. The interviewer may preface the probing with. a remark 
like 'I'd like to talk a little about each of these things separately , " and then prd)e. In, 
sucA a case, the respondent may end up clarifying all his remarks without further 
probing. If not, the interviewer must continue to probe each item until all the answers 
are clear. 

Making a judgment about whether an answer is clear is often difficult. In general, it 
is better to probe than not to proJ)e. However, it is important to be sure to probe the 
answer to the specific question, rather than pose a new question to the respondent. 
For example: 

Q. Why did you choose this place to live? 

A. Because it's convenient. 

Q. Convenient? 

A. Yes, this apartment is only a 10 minute drive to my office. 

Q. Why do you want to live close to your office?^ 

This final probe is inappropriate becaude the question itself is about the reasons for a 
choice, rather than the reasons for the reason. New interviewers sometimes assume 
either that too much is understood or that nothing is understood. The best way to make 
a judgment about the need for probing is to understand the intent of the question and to 
evaluate the response in light of that intent. It is important to.be sure to probe the 
point of the question. 
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Probing for Completane« or Additional Information 



Once^a-clear-answer bas been obtained, the interviewer Suould probe for additional 
responses to the question. The best way to do this is to repeat the substance of the 
question as part of a request for further information. For example: 

What else do you like ? ^ 

What other reason did you have ? 

Anofiier good tactic provides positive feedback and at the same time encourages the 
respondent to be thoughtful. This Involves reading back the response obtained thus 
far, combined with a question like the examples abpy.e. For example: "Let's see, 
you said you chose this place to live because it's only a ten-minute drive to your 
office. What other reason did you have for choosing this place to live? " 

Other types of probes can also be valuable. A simple "What else? " is occasionally a 
satisfactory probe, but this should not be used too often because it tends to become 
mechanical: the R may forget the original question or become sidetracked. It should, 
be noted that "la there anything else? " is a leading probe becjiuse it can too.easily be 
answered by a NO. It may also make the R feel that the interviewer is more interested 
in moving on to the next question than in hearing anything else the R might have to say. 

To recapitulate: each additional response should be probed for clarity as necessary. 
Only when a clear and unambiguous response has been obtained should the interviewer 
probe for additional responses. The interviewer should continue probing for additional 
responses until the R indicates that he has nothing else to say on the subject. The in- 
terviewer should be sure to record his final remark.. 

One point is especially important: the interviewers should be instructed never to probe 
until the respondent says '^That's all, " nor should "That's all" be used in examples or 
mock interviews. Experience shows that interviewers tend to become obsessed with 
recording this phrase at the end of questions and thus lose sight of the fact that the goal 
is not to record "That's all" at the end of every open-ended question, but rather to be 
sure to probe until the R really has nothing else to say. 
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APPENDIX K 



SAMPLE AGENDA FOR 
INTERVIEWER TRAINING SESSION 



bay #1 8:30 A. M. Welcome,, introductions, overview of the training program. 

9:00 A.M. The study, its history, its purpose and goals: why we are 
doing the study., 

9:30 A.M. The respondents and privacy. The plan for anonymity of 
respondents and, confidentiality of data. 

iO:OOA.M. Coffee break. 

10:30 A.M. The respondents: who they are, the kind of experiences 
they've had as drug users and at the treatment center. 

12:00 P.M. Lunch. 

1:30 P. M. Content of the questionnaire: question-by-question review. 

3:00 P.M. Break. 

3:30 P. M. Review of interviewing techniques. 

Day #2 8:30 A. M. Mock interviews (interviewers will be assigned to a group to 

do mock interviewing using each other as respondents). 

10:30 A.M. Coffee break. 

11:00 A.M. Group reports: discussion of mock interview experiences. 
12:00 P.M. Lunch. 

1:30 P. M. Drugs: what they are and what effects they have (A qualified 
person will speak on this topic.) 

2:00 P.M. The interviewer's tasks before the interview. Contacting and 
locating the respondents. Answering respondent's questions. 
Arranging the place for interviews. Arranging the time for 
interviews. Dealing with difficult situations: respondents 
who refuse; respondents who brealc ^pointments; respondents 
who can't afford to come to be interviewed. 

3: 30 P. M. Coffee break. 

4:00 P.M. The interviewer^s tasks after the interview. Paying re- 
spondents (if they are to be paid). Answering respondents' 
questions. Returning the questionnaire. 
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8:30 A.M. 

10:30 A.M. 
11:00 A.M. 
12:30 P.M. 
2:00 E.M. 

3:30 P.M. 

8:30 A.M. 
10:30 A.M. 
11:00 A.M. 
12:15 P.M. 

1:45 P.M. 

4:45 P.M. 



Interviews (interviewers will be assigned to a.grpup to in- 
terview paid respondents) (one interview, two interviewers 
observing), 

Coffee break. 

Discussion of experiences while interviewing. 
Lunch. 

Life patterns of heavy drug users (discussed by a qualified 
person). 

Interviews with a paid respondent (an interviewer who c*- 
served at 8:30 will interview, with two other interviewers 
observing). 

Survey administration: record keeping. 
Coffee break. 

The interviewer's role in preserving confidentiality of data. 



Interviews with paid respondents (the interviewer who ob- 
served both sessions on Day #3 will be the interviewer, with 
two observers). 

Editing completed questionnaires. 
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APPENDIX L 



INSTRUCTIOI^S FOR INITIAL FIELD 
STAFF CONTACT WITH CLIENT 

Introducing Yourself .in Person 

^en you speak to the respondent personally, give him your name and the name of 
your employer, and explain why you want to talk to him. The conversation should go 
something' like thisr 

"Hello, rm from the X Medical Care 

Study. We are currently doing a health study and you have been 
selected as a respondent. I would like to arrange a convenient 
time to interview you. When would that be? 

In many ways, it is easier to introduce yourself in person than it is by phone. If you 
are at the address of the respondent, ask to see him personally. If you are at the home 
of a contact, ask to see the person whose name you have. If that person is not home* 
go ahead and make your inquiries with the person answering the door. Always have 
your i. D. card or letter of introduction handy in case someone doubts your identity. 

When you are face to face with the respondent himself, immediately give your name 
and state your purpose. Then confirm his identity — you wouldn't want to interview 
the wrong person. A good question mi^t be: In what year were you born? (To con- 
firm the ^year, check your face sheet — • the sheet you should have for each respondent 
to list any information which might help in locating the respondent.) Be ready to 
answer the respondent's questions, if he has any after reading the letter. Be sure to 
give him plenty of time to verbalize them so that later he will not think of things he 
wished he had asked ~ things that might be serious enough in his mind to cause him 
to break an appointment or to refuse to complete an inter\dew. 

If the respondent is ccicerned about confidentiality, tell him something like this: 

Everything you tell me is absolutely confidential. Your name will not 
even go on the questionnaire. All your answers will be put with those 
of other people like you and will be released in statistical form only. 

If the respondent wonders how you got his name: 

The study was given your name by the treatment center in order to do 
this study. I have a copy of a law here that explains why they could 
.give us your name. (SHOW LAW ALLOWING RELEASE OF RE- 
SPONDENT'S NAMES) Of course, everything you say is coafidential. 
Your name doesn't even go on the questionnaire. Your answers will be 
combined with other people's answers and will be released only in 
statistics. 

Some respondents may want to be sure you are not from the government. Show your 
L D, card. If he still is not convinced, let him call the study office or the treatment 
center. 
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Often respondents may want to know what they will get out of the study, and what good 
it will do them. The proper answer is that they are making a very important contri- 
bution towards the solution to a serious problem in our society today. A great deal of 
money has gone into treating drug addicts and alcoholics; some of it has been wisely 
spent, some of it has not. Since this person has experienced at least one kind of 
treatment, what happened to him is important in deciding what kind of treatment will 
be used for people like him in the future. If he didn't like the treatment center or the 
kind of treatment he received, explain that you need that information from him, but 
that you have to ask him the questions in order for his opinions to be included. Other- 
wise, all the people like him that he represents will be loft out. Their experiences, 
as reflected in his answers, need to be included in the study so that it will reflect both 
good and bad experiences in treatment centers. Tell him that the results of the study 
will play an impoi:tant role in the design of future treatment programs. 

In summary', make your answers to the respondent's questions brief and to the point. 
Your job, in explaining the study to the respondent, is to observe the fine line between 
too much and too little explanation to the respondent. Too much explanation will make 
him nervous he won't understand why you are defending points that haven't occurred 
to him as needing defense. But too little explanation will leave him uncertain as to 
your identity, what you want, and why he should help you. 

Introducting Yourself on the Phone 

If you are calling the respondent's home, ask to speak to him personally. If he is not 
in, find out when he would be available, or whe.re you could reach him. If the person 
who answers the phone wants to know who you are, give your name and say you are 

from the X Medical Care Study. If the party wants to know why you are 

calling, say that the resp ..Jent has been selected by a random process to participate 
in a health study, and you would like to get in tonrh with him to arrange for an inter- 
view. Give out only as much information as necessary so as not to cause worry on the 
part of the respondent or his family, but give e lough to gain the cooperation of the 
person you have contacted. 

If you arc emailing a contact, or reference, rather than the respondent himself, ask for 
the party with whom you wish to speak. WTien you reach that person, identify yourself 
by name and identify the study you are from. Ask if the contact knows anything that 
would help you locate the respondent, and tell why you want to locate him. Be as 
friendly and cordial as possible. Sometimes, contacts will worry that yoa are in- 
terested in obtaining information about them personally. Assure them that such is not 
the case. Sometimes a family member v/ill not give out any information about the re- 
spondent until he or she is assured that you should have such information. Al this 
point, tell them that the respondent has been selected to participate in a health study, 
that his name was picked randomly, and, most importantly, that any information given 
is confidential. If you can get nothing from the contact, leave your name and phone 
number so that the respondent can get in touch with you. 
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